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SOME PRINCIPLES OF THE THEORY OF TESTING HYPOTHESES! 


By E. L. LEHMANN 
University of California, Berkeley 


Introduction : 

1. The likelihood ratio principle. The development of a theory of hypothesis 
testing (as contrasted with the consideration of particular cases), may be said 
to have begun with the 1928 paper of Neyman and Pearson [16]. For in this 
paper the fundamental fact is pointed out that in selecting a suitable test one 
must take into account not only the hypothesis but also the alternatives against 
which the hypothesis is to be tested, and on this basis the likelihood ratio princi- 
ple is proposed as a generally applicable criterion. This principle has proved 
extremely successful; nearly all tests now in use for testing parametric hypoth- 
eses are likelihood ratio tests, (for an extension to the non-parametric case 
see [33]), and many of them have been shown to possess various optimum proper- 
ties. 

At least in the parametric case the likelihood ratio test has a number of desir- 
able properties. Among these we mention: 

(i) Frequently it is easy to apply and leads to a definite and reasonable test. 
(ii) If the sample size is large, and if certain regularity conditions are satisfied 
an approximate solution can be given for the distribution problems that arise 
in the determination of size and power of the test (Wilks [82], Wald [25]). In 
fact, if the likelihood ratio is denoted by A, —2 log \ approximately has a central 
x’-distribution under the hypothesis, a non-central x’-distribution under the 
alternatives. The number of degrees of freedom in these distributions equal the 
number of constraints imposed by the hypothesis. 

(iii) As was shown by Wald [25], under certain restrictions the likelihood ratio 
test. possesses various pleasant large sample properties. 

In view of this, one may feel that the likelihood ratio principle, although per- 
haps not always leading to the optimum test, is completely satisfactory, and 
that a more systematic study of the problem of test selection is not necessary. 
Unfortunately, against the pleasant properties just mentioned there stands a 
very unpleasant one. Cases exist, in which the likelihood ratio test is not only 
unsatisfactory but worse than useless, and hence the likelihood ratio principle 
is not reliable. Examples of this kind were constructed independently by H. 
Rubin and C. Stein; the following is Stein’s example. 


1 Parts of this paper were presented in an invited address at the meeting of the Institute 
of Mathematical Statistics on Dec. 30, 1948, in Cleveland, Ohio. 
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Let X be a random variable capable of taking on the values 0, +1, +2 with 
probabilities as indicated: 











—2 2 —1 1 0 
, a a 1 1 
Hyy othesis H: 5 5 57% ——s a 
Alternatives: pC (1 — p)C —* G = «) fe ( - «) a ~ c 
Here a, C are constants, 0 < a S 3, = < C < a, and p ranges over the 
a 


interval [0, 1]. 

It is desired to test the hypothesis H at significance level a. The likelihood 
ratio test rejects when X = + 2, and hence its power is C against each alterna- 
tive. Since C < a, this test is literally worse than useless, for a test with power 
a can be obtained without observing X at all, simply by the use of a table of 
random numbers. It is worth noting that the test, which rejects H when X = 0, 


1— ae 
has power a +—< > a, so that a reasonable test of the hypothesis in ques- 


tion does exist. 

The existence of such examples gives added importance to the problem of 
developing a systematic theory of hypothesis testing. It is the purpose of the 
present paper to give a brief survey of the work done on some aspects of such a 
theory and to indicate certain extensions and modifications of the existing theory. 
Some examples and applications will be considered. These will be restricted to 
parametric problems. For applications to testing non-parametric hypotheses 
see [12]. 

The results of sections 5 and 8 were obtained jointly by Gilbert Hunt and 
Charles Stein in 1945. They have not been published and were communicated 
to me by Professor Stein. I should like to express to him my gratitude for ac- 
quainting me with this material and for giving me permission to include it in 
this paper. I should also like to acknowledge my indebtedness to Professor 
Henry Scheffé who read the manuscript and made many helpful suggestions. 

2. Formulation of the problem. The problem of testing a statistical hypothesis 
was formulated by Neyman and Pearson [18] as follows. 

A random variable X is known to be distributed over a space ¥ according to 
some member of a family of probability distributions {P¢}, @¢Q. It will be 
assumed here that there is specified an additive class $ of sets in ¥, and that 
the probability distributions Pf are probability measures defined over %. All 
sets or real valued functions mentioned in this paper will be assumed meas- 
urable $ unless otherwise stated. If B «8, we shall write for the measure as- 
signed to B by P# interchangeably Pj (X eB), P¢(B), and if there is no possi- 
bility of confusion, Ps(B). Throughout most of the paper it will be assumed 
that the probability measures Pj are absolutely continuous with respect to a 


x fF © 
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given sigma finite measure uv defined over %, so that there exist non-negative 
functions fe such that 


(2.1) PB) = [ fo(x) du(x). ¥ rd 


We shall then say that fe(x) is a generalized probability density w.r. to u. 

A statistical hypothesis H specifies a subset w of 2, and states that the dis- 
tribution of X is some P¢ with @ €w. A test of H is any subset w of X, the con- 
vention being that H is rejected if the observed value z of X is in w, and that 
in the contrary case H is accepted. The selection of w is to be made as follows. 
A number a is given, 0 < a < 1, the level of significance, and w must be such 
that 


(2.2) Po(w) = a@ for all 6 €w. 


Subject to this restriction it is desired to maximize P,(w) for @ in Q — w. The 
interpretation of these conditions is immediate. Since P»(w) is the probability 
of rejecting H computed under the assumption that P% is the distribution of 
X, equation (2.2) states that the probability of rejecting H is to be a (usually 
some small number such as .01 or .05) whenever H is true. Similarly the second 
condition expresses the fact that H is to be rejected with high probability when 
6isinQ — w. 

Naturally the second condition is not to be taken literally but rather as a 
loosely stated principle of choice. For in general there will exist a unique set 
w maximizing P»,(w) for any given @, «2 — w, but this w will change with 6, . 
The condition has a clear meaning only in the case that the set 2 — w contains 
only a single point, and in a few special problems in which the same set w maxi- 
mizes P,(w) for all 6 «2 — w. In the general case there are available two main 
methods for making the condition precise. One may restrict consideration to 
some class of “nice” tests, so that within this class the maximization of P»(w) 
can be achieved uniformly for 6¢«2 — w. Alternatively, instead of asking that 
a local optimum property hold uniformly, one may look for a test whose power 
function possesses some optimum property in the large. Both of these ap- 
proaches have an element of arbitrariness. In the first, the selection of a class 
of nice tests, in the second, the choice of an appropriate optimum property. 
Fortunately, in a number of important special cases, both methods, for various 
reasonable definitions, lead to the same test. 

Before proceeding with this development, we shall modify the formulation 
of the problem slightly. First, as has been pointed out by many writers, it seems 
more natural to replace (2.2) by 


(2.3) P,(w) S @ for all 6 €w. 


Secondly, we shall permit ‘‘randomized” tests (see [11, 29]), that is, instead of 
demanding that the statistician decide for each value of x whether to accept 
or to reject H, we shall allow the possibility that for certain x the decision be 
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reached by means of some chance device such as a table of random numbers. 
By a test of H we shall therefore mean a function ¢ from ¥ to the interval 
[0, 1], with the convention that when z is the observed value of X some chance 
experiment with two possible outcomes R, R will be performed such 
that P(R) = ¢(x), and that H will be rejected when the outcome is R and will 
otherwise be accepted. The case of a non-randomized test w clearly is obtained 
as a special case by taking for ¢ the characteristic function of the set w. 
For a test ¢ the probability of rejection is given by 


(2.4) [ $(z) d PX(x) = Ex6(X) 


where E, denotes expectation computed with respect to the probability dis- 
tribution P . We therefore obtain the following formulation of the problem: 
To determine a test function ¢ (0 S ¢(x) S 1) which maximizes Ey ¢(X), the 
power of ¢ against the alternative 0, for 6 in Q — w subject to the condition 


(2.5) Ee@(X) S e@ for all 0 €w. 


In this connection it is convenient to use the term “level of significance’’ for 
the preassigned number a, and to define the size of the test ¢ as 


(2.6) sup Eoo(X). 


Except in the trivial case that there exists a test of size < a whose power is 1 
against all alternatives, the size of any optimum test (in fact, of any admissible 
test) equals the level of significance. 

3. Testing against a simple alternative. A complete solution of the problem 
formulated in the last section is available only in the case that w and 2 — w 
each contains only a single point, that is, in the case that both the hypothesis 
and the alternative are simple. The solution is then given by the fundamental 
lemma of Neyman and Pearson [18], which we may state in the fol- 
lowing slightly more complete form. 

THEOREM 3.1. Let 


(3.1) P,(A) = [ fel) du(z). 


(a) For testing the hypothesis H: 0 = 65 against the alternative @ = 6, at level of 
significance a, there exists a number k and a test of size a such that 

o(z) = 1 when fo,(x) > kfe,(x), 

o(x) = 0 when fe,(x) < kfo,(z). 

(b) If fo,(x) and fe,(x) are ~ O forall x in &, thena test @ is most powerful for 
testing H against 6 = 6, if and only if it satisfies (3.2) except possibly on a set 
of u— measure 0? . (Note that the number k of (3.2) is essentially unique). 


(3.2) 


2 Throughout the paper we shall consider two tests as equal if they differ only on a set 
of u-measure 0. 


ee ae a ee. a 
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The second half of the theorem may be paraphrased by saying that under 
the conditions stated the most powerful test is uniquely determined by (3.2) 
except on the set on which 


(3.3) fo, (x) = ki fog(x). 

On this set the value of ¢ may be assigned arbitrarily provided the resulting 
test has size a. If in particular the set on which (3.3) holds has measure 0, the 
most powerful test is unique. 

It should be mentioned that (3.1) is no restriction since any two probability 
measures P,, P2 defined over a common additive class can be represented in 
this form with » = P, + P.. If the assumption of (b) is not satisfied, the 
theorem is still true in essence but some trivial modifications are necessary. 

No such complete solution is available for the problem of testing a composite 
hypothesis against a simple alternative. However, as was shown in [11], this 
problem may in many cases be reduced to the one just considered. Let the 
hypothesis state that 6 is an element of w, and consider the simple alternative 
6 = 6,. Suppose that an additive class of sets has been defined on w (in most 
of the applications w is a subset of Euclidean space, and the additive class is 
formed by the Borel sets contained in w). Then for any probability distribution 
A over w, 


(3.4) n(x) = [ falz) a(0) 


is a probability density function with respect to yu. 

Under certain conditions to be stated below, the most powerful test ¢ for 
testing the simple hypothesis H, that X is distributed with probability density 
h, against the alternative fo, is also most powerful for testing the original hy- 
pothesis H against the same alternative. This is essentially the Bayes approach 
developed by Wald for his general decision theory, and in fact, under the con- 
ditions which we shall state, A is a least favorable distribution over w in the 
following sense. Let 6, be the power of ¢ against fe, , and for any distribution 
A* over w denote by Hy. , dr» , Bae the associated hypothesis, the most powerful 
test for testing it against fs, , and the power of this test respectively. Then A 
is said to be least favorable if for all A* 


(3.5) Br S Bre. 


THEOREM 3.2. Suppose there exists a probability distribution X over w such that 
the most powerful test o, of size a for testing H) against fo, is of size a also with 
respect to the original hypothesis H. Then 
(i) ¢, ts most powerful for testing H against fo, ; 

(ii) \ zs a least favorable distribution. 

Also, if oy is the unique most powerful test for testing Hy against fo, , it is the 
unique most powerful test for testing H against fo, . 

These results are essentially contained in Wald’s work (see for example 
theorem 4.8 of [26]). 
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There are many trivial applications of this theorem to finding most powerful 
tests of one-sided hypotheses concerning a single real-valued parameter, such 
as testing H: p S mm against p = pi(po < p:) when X has a binomial distribu- 
tion with parameter p. As is well known, it turns out in a number of these cases 
that the most powerful tests are in fact uniformly most powerful against the 
one-sided class of alternatives. 

In [11] Theorem 3.2 was used to determine most powerful tests of certain 
hypotheses concerning normal distributions. As an example consider the case 
that X,,--- , X, are independently normally distributed with common mean 
& and variance o?. Denote by H; and H2 the hypotheses ¢ = 1 and &— = 0 re- 
spectively, and let the alternative be: & = & , o? = oi . Then the most powerful 
test of H, rejects if 
(3.6) Za; — &)? < kh when o <1, 

2(x; — Z)? >a when o> 1, 


and accepts otherwise. Here /; and c, depend only on the level of significance, 
that is, are independent of & , o; . If &; > 0, the most powerful test for testing 
Hz rejects if 


Z(e; — b)! Sb? when a < 3, 


z 
SS So when ai 
—V = (a; —_ Z)? ae - 


and accepts H2 otherwise. Here k2 and cz depend only on a, while b depends on 
& » O1 and a. 

These results indicate that even when the class of alternatives is larger than 
in the above problems, some improvement over the standard tests may be 
possible provided good power is desired only against a narrow class of alter- 
natives. 

4. Sufficient statistics. Before treating the problem of composite alternatives, 
we shall consider an important simplification that can be obtained by making 
use of sufficient statistics. This notion was introduced by R. A. Fisher, and was 
further developed by J. Neyman [13] and in [2] and [10]. Consider any meas- 
urable partition of ¥. For any point z in &, let t(x) be that set of the partition 
in which z lies. A set in the range of ¢ is said to be measurable if the correspond- 
ing set of points z is an element of %. Denote the class of measurable t-sets by 
Wf. Then the statistic T = t(X) is a random variable defined over 2. Kolmogoroff 
has shown how for any Be% one can define the conditional probability 
P(B | t) of B given T = t uniquely up to a set of measure zero by the equation 


(3.7) 


(4.1) P(BNE(A)) = | P(B|) dP") forall 4 e¥ 


Suppose now that we are given a class § of probability distributions for X, 
§ = {Pé}, @€2. Denote by P,(B | t) the conditional probability of B given 


ap ~ — mr at 


 _, th Oe doe 
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T = t computed for the distribution Pj . The statistic T is said to be a suffi- 
cient statistic for § (or for 6) if for every B e S there exists a determination of 
P,(B | t) that is independent of @. 

According to the above definition of statistic, t(x) is an element of a meas- 
urable partition. However, one may consider instead any function ¢* for which 
t*(x) = t*(x’) if and only if t(z) = t(z’), that is, any function that leads to this 
partition; the values that the function takes on are really immaterial. It will 
be convenient here to use this wider definition of statistic. For a rigorous treat- 
ment of some of the problems that will be referred to one needs to define an 
equivalence of statistics and to include in this definition the appropriate nullset 
considerations. A detailed account of these matters is given in [2] and [10]. 

From our present point of view tests are compared solely in terms of their 
power functions. On this basis two tests ¢, and ¢2 may be considered equivalent 
if they have identical power, that is, if 


(4.2) Ewp:i(X) = Eegbo(X) for all 0 € Q. 
We can then state 
TuHeoreM 4.1. If T is a sufficient statistic for 0 and ¢(X) any test of a hypothe- 


sis concerning 6 then there exists an equivalent test that is a function of T only. 
The proof of this theorem is immediate since 


(4.3) W(T) = El¢(X) | T] 
is such a test. 

It follows from Theorem 4.1 that we lose nothing by restricting considera- 
tion to tests based on a sufficient statistic.* The problem of determining whether 
or not some statistic is sufficient for a given family of distributions is simplified 
through the use of a criterion for sufficiency that can be checked on sight. This 
criterion is due to Neyman [13] who proved it in a somewhat special setting, 
and was recently proved in a very general form by Halmos and Savage [2]. 
It states that if § = {pe}, @¢€2 is a family of generalized probability densities 
for X, then under certain mild restrictions a necessary and sufficient condition 
for T = t(X) to be a sufficient statistic for § is that pe(x) factors into one fac- 
tor depending on @ but on x only through ¢(x) and a second factor depending 
only on 2. 

The question arises as to which of various sufficient statistics to use. Since 
the purpose of introducing sufficient statistics is to reduce the complexity of a 
given statistical problem, one is led to seek a sufficient statistic that reduces 
the problem as far as possible and hence to the notion of a minimal sufficient 
statistic, a sufficient statistic 7 being minimal if it is a function of every other 
sufficient statistic (see [10]). It can be shown under fairly general conditions 
that a minimal sufficient statistic exists, and one can give an explicit construc- 
tion for it. 


3 A justification for the use of sufficient statistics in the general statistical decision prob- 
lem was given in [2]. 
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As one would expect it turns out that the sufficient statistics commonly 
associated with various families of distributions are actually minimal. Thus for 
example, if X1,--- , X, are independently normally distributed with common 
mean é and variance o’ , the statistic (X, =(X: — X)*) is a minimal sufficient 
statistic for 6 = (&, o). If X,, --- , X, are independently uniformly distributed 
over (0, 6), max(X,, --- , X,) is the minimal sufficient statistic for 6. If § is 
the family of distributions according to which X,, --- , X, are identically in- 
dependently distributed according to an arbitrary univariate distribution (or 
according to an arbitrary probability density with respect to a fixed univariate 
measure), then the minimal sufficient statistic is obtained by defining for each 
point x = (x, ---, 2n) the set t(x) as the set of points obtainable from x by 
permutation of coordinates. Alternatively one can define it by t(a,--- , tn) = 
(Za;, Daj, +++, Ua). 

5. The principle of invariance. The notion of invariance was introduced into 
the statistical literature in the writings of R. A. Fisher, Hotelling, Pitman [20] 
and others, in connection with various special problems. A general formula- 
tion was given by Hunt and Stein who, in an unpublished paper [5], utilized 
this notion to find most stringent tests, and who obtained the examples of uni- 
formly most powerful invariant tests that will be given below. The point of 
view in the present section is different from theirs however, since here invariance 
will only be considered as an intuitively appealing restriction that one may 
wish to impose on statistical tests. 

We shall begin by considering an example. Suppose it were known that the 
height of people is distributed about a known mean, which for convenience we 
shall take to be zero, either according to a normal or to a Cauchy distribution, 
with unknown scale factor so that either 


(5.1) f(x) = - - exp (-Z.) 0<0< & 
V 29 0 26 
or 
(5.2) fo(x) = : _ 0<0< a, 
r@ + x 


Suppose we wish to test from a sample X,, --- , X, the hypothesis H that the 
true probability density belongs to the first of these classes against the alterna- 
tive that it belongs to the second. Then it seems desirable that the decision of 
whether or not to accept H should be independent of the scale adopted for 
measuring the heights. For otherwise one worker expressing his data in feet 
might reject H while another worker using the same data but expressing them 
in inches would reach the contrary decision (In this connection see for example 
[34], p. 104). A “‘nice” test function ¢ therefore would be independent of the 
choice of scale, i.e., it would satisfy the condition 


(5.3) o(ct1, °°: , Ctn) = O(%1,°°- , Xn) for all c > O and for all (m1, --+ ,2n) 


except possibly on a set N, independent of c and of measure zero. 


=sS ©. = Fe 
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On analyzing this problem one is led to the following observation. Multiply- 
ing each of the random variables X,,---, X, by the same constant leaves 
both w and Q — w invariant, i.e., if the X’s are normally distributed with zero 
mean and arbitrary scale so are cX,, --- , cX, , and analogously for the Cauchy 
distributions. It is this fact that makes it so desirable to have ¢ invariant under 
multiplication of the z’s by a common constant. 

More generally consider measurable 1:1 transformations g of ¥ into itself, 
and let Y = gX. Suppose that when X is distributed according to @¢€w, Y is 
distributed according to 6’ € w—we shall then write 6’ = gé—and that as 6 
ranges over w so does 6’. Suppose that the analogous condition is satisfied for 
Q — w, so that the problem of testing w against 2 — w is left invariant under g. 
Now whether one expresses the observations in terms of X or in terms of Y is 
essentially a matter of choice of coordinates. The principle of invariance asks 
that if such a change of coordinates leaves the problem invariant, then it should 
also leave the test invariant, i.e., if G is a group of measurable 1:1 transforma- 
tions of ¥ such that 


(5.4) gw = w and gQ — w) = Q — w for all g eG, 
then ¢ should satisfy the condition 
(5.5) o(gx) = $(z) for all g € G, 


and for all x except on a set N independent of g and such that u(N) = 0. If this 
condition were not satisfied, two workers, using the same data but expressing 
them in different coordinate systems might arrive at contrary conclusions. 

As an example consider the general linear univariate hypothesis. In canonical 
form X,,--- , Xr; Xr41,°°* , Xs; Xeit,°** , Xn are independently normally 
distributed with common variance. The means of the first s variables are un- 
known, the means of the last -s variables are known to be zero. The hypothesis 
states that the first r means are zero. Adding arbitrary constants to each of the 
variables of the middle group leaves w and 2 — w invariant. So does any orthogo- 
nal transformation of the first r variables, and any orthogonal transformation of 
the last n — s variables. Finally, the problem is also left invariant when all of 
the variables are multiplied by the same constant. It is easy to see that a 
function ¢ is invariant under these transformations if and only if it is a func- 
tion of 
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t=1 t=s+1 
But, as is well known and easy to show, among all tests based on this statistic 
there is a uniformly most powerful one, namely the test that rejects H when 
rT n 
2 2 
2% f 2. % 
t=1 t=s+1 
is too large. Therefore, among all tests satisfying the condition of invariance 
the standard test is uniformly most powerful. 
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To formulate a corresponding reduction procedure in general, we define a 
function h on X¥ to be maximal invariant (under G@) if it is invariant 
and if h(x’) = h(x) implies the existence of g ¢G such that 2’ = gx. Then a 
function ¢ on & is invariant under G if and only if it depends on zx only through 
h(x), that is, if there exists a function ¥ such that g(x) = y[h(x)]. Hence a neces- 
sary and sufficient condition for a test to be invariant under G is that it be 
based on the statistic Y = h(X). The principle of invariance therefore reduces 
the problem from X to Y = h(X). To determine the resulting statistical re- 
duction, that is, the simplification of the parameter space, one may consider 
the group G of transformations over @ induced by G. If v(@) is a maximal in- 
variant function under G, it is easily shown that the distribution of Y depends 
only on v(6@). Hence under the principle of invariance any two 6-values with 
common v(@) (that is, such that each can be obtained from the other by a trans- 
formation of @) are identified. If in particular v(@) is constant over w, the hy- 
pothesis H, when expressed for Y, becomes simple, and there may even exist 
a uniformly most powerful invariant test. 

Besides for the example already mentioned this is the case for Hotelling’s 
T?-problem and for the hypothesis specifying the value of a multiple correla- 
tion coefficient. Another example is obtained when X,, --- , X, are independ- 
ently identically distributed, each with probability density ps(x) where under 
H; po(x) = fi(x — 0), @ = 0, 1), and where it is desired to test Ho against H, . 
One may also in this example replace the location parameter by a scale param- 
eter or have both parameters present. 

It may be worth noting that the likelihood ratio test is invariant under any 
transformation leaving the statistical problem invariant. In the problems con- 
cerning normal distributions mentioned above, when there exists a uniformly 
most powerful invariant test, it coincides with the likelihood ratio test. That 
this is not so in general can be seen from Stein’s example given in section 1. 
There the problem remains invariant under multiplication of X by —1, and 
there exists a uniformly most powerful invariant test. However, the likelihood 
ratio test is instead uniformly least powerful. 

For certain applications it is more useful to consider a somewhat weaker 
definition of invariance. We shall say that a function ¢ is almost invariant under 
a group G of transformations if for each g eG, g(gx) = ¢(x) for all x except on 
a set N, such that u(N,) = 0. This definition differs from the previous one in 
that the null set N, is now permitted to depend on g. It was shown by Hunt 
and Stein that under certain conditions on G, which are satisfied for the prob- 
lems mentioned above, any almost invariant test is invariant. 

We have indicated how for certain hypotheses one can find a group of trans- 
formations leaving the problem invariant, such that among all tests invariant 
under this group there exists a uniformly most powerful one. The question may 
be raised whether this approach is consistent, or whether there may exist some 
other group of transformations also leaving the problem invariant but leading 
to a different test. Also in problems where among all invariant tests there does 
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not exist a uniformly most powerful one, the question arises whether one is 
using the totality of transformations leaving the problem invariant, or whether 
perhaps one can reduce the problem further. It therefore seems of interest to 
determine the totality of transformations leaving a given problem invariant. 
This was carried out for a few simple problems in [8]. 

We finally mention a connection between the notions of invariance and suffi- 
ciency. Consider any problem in which the variables X,,---, Xn are inde- 
pendently identically distributed under all distributions of 2. Such a problem 
clearly is left invariant under any permutation of the variables. Actually, these 
transformations leave not only w and Q — w invariant but each point of Q in- 
dividually. No essential reduction of the problem is obtained since the maximal 
invariant statistic is a sufficient statistic. It is easily seen that this will always 
be the case when the transformations leave 2 pointwise invariant, but that in 
this way one does not obtain all sufficient statistics. These can be obtained, 
however, by considering more general transformations, where each point x of 
¥ is transformed into the points of ¥ according to a probability distribution P, . 


6. The principle of unbiasedness. As a second principle of reduction we shall 
consider the principle of unbiasedness proposed by Neyman and Pearson. A 
test is said to be unbiased [19] if 


P» (rejecting H) > a for all 0€Q — w. 


This seems a desirable property for a test to have since it assures that there do 
not exist 4 in w and 6, in Q — w, for which 


Po, (rejecting H) > Po, (rejecting A). 


We shall therefore be concerned in this section with the totality of tests ¢ for 
which 


E,e¢(X) < a@ forall dew 
Eo¢(X) >a forall 6€Q2—w. 


(6.1) 


For a number of important special cases there exists, among all tests satisfying 
(6.1), one that is uniformly most powerful in Q — w and uniformly least power- 
ful in w. (The latter property is of course very desirable since when H is true 
one wants to reject it as rarely as possible.) This follows immediately from well 
known results concerning best similar tests since for the problems in question 
Q is a subset of a Euclidean space and for any test ¢, Ee@(X) is a continuous 
function of 6. If then A is the set of points that are boundary points both of 
w and of 2 — w, it follows from (6.1) that 


(6.2) Ew(X) = a for all 6 € A, 


1.e., that ¢ is similar for @ in A. But if among all tests satisfying (6.2) there 
exists one that is uniformly most powerful in Q — w and uniformly least power- 
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ful in w, it automatically satisfies (6.1) as is seen by comparison with the test 
o(X) = a. 

As an example suppose that Xi;,---, X, are independently normally dis- 
tributed with common mean ~ and common variance o . If the hypothesis is 
H,:o < 1 and the alternatives are oc > 1, the set A becomes the line o = 1. 
As was shown by Neyman and Pearson [18], among all tests satisfying (6.2) 
with this A, the test that rejects Hi when 2(x; — Z)° < k (where k is an appro- 
priately chosen constant) is uniformly most powerful for @ in Q — w, and uni- 
formly least powerful for @ in w. 

If instead we consider testing the hypothesis H,: ¢ = 1 against the alterna- 
tives o #1, we find that A = w, and our problem reduces to that of finding the 
best test among all those that are similar in w and unbiased. As is well known, 
it turns out that rejecting when 2(r; — @)° < i, and when X(x; — %)” > ke 
(where ki < hk. are two appropriately chosen constants) is uniformly most 
powerful among all similar unbiased tests. 

A third hypothesis concerning o that might be of interest is H3: 01 < o¢ < 
o2. Here A consists of the two lines ¢ = o; and o = o2 and it is easy to show 
that the test that is uniformly most powerful in 2 — w and uniformly least power- 
ful in w rejects H; if and only if S(x; — %)° < cq or 3(x; — #)” > c where again 
C1 < Cz are two appropriately selected constants. 

The question arises as to the connection of the principles of invariance and 
unbiasedness. Clearly if there exists a unique test ¢@ that is uniformly most 
powerful unbiased, this test is invariant under any group G leaving the problem 
invariant. If then in addition there exists a uniformly most powerful invariant 
(under G) test, this must coincide with ¢. Thus, if both principles lead to a 
unique optimum solution, these solutions coincide. 

We have seen that frequently optimum unbiased tests can be obtained 
through a study of tests that are similar over certain sets in the parameter 
space. The totality of similar tests was obtained for a number of important 
problems by Neyman and Pearson. In his 1937 paper on confidence intervals 
[15] Neyman gave a general method for constructing similar regions with the 
help of sufficient statistics. Let T be a sufficient statistic for @ «A. The condi- 
tion for ¢ to be similar with respect to A and of size a, is that 


(6.3) Eob(X) = EoE[o(X) | T) = o@ for all 0 €A, 
i.e., that 
(6.4) Ee{ E|o(X) | T] — a} = Ofor all O€A. 


Clearly any test @ for which 
(6.5) E|¢(X) | t] = o@ for almost all ¢ 


is similar. This is the construction given by Neyman, and we shall say that a 
test @ satisfying (6.5) has the Neyman structure with respect to 7. The ques- 
tion whether this exhausts the totality of similar tests is easily reduced to an 
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analytic problem the solution of which is known in many special cases. This 
method was first employed by P. L. Hsu [8] for some problems concerning 
normal distributions, and was extended to other cases in [7]. The present gen- 
eral formulation was given by H. Scheffé and the author in [9] and [10]. We 
shall say that a family of distributions {Ps}, @€A, is boundedly complete if 

(i) f(t) is bounded, 

(ii) Eof(T) = O for all @€A ; 
imply f(t) = 0 except on a set N with Po(N) = 0 for all 6¢A. Then we can 
state 

THEOREM 6.1. A necessary and sufficient condition for the totality of tests simi- 
lar for A to have Neyman structure with respect to a sufficient statistic T is that 
{P¢}, 0 €A, be boundedly complete. 


7. Tests whose power increases with the distance from the hypothesis. 
Frequently, even among the unbiased tests, there does not exist a uniformly 
most powerful one. The general univariate linear hypothesis with more than 
one constraint is an example of this situation. The following extension of the 
idea of unbiasedness may then be used to reduce the class of tests still further. 
Unbiasedness distinguishes between values of 6 as they belong to w or 2 — wo. 
However, one may further classify the points of 2 — w according to their ‘‘dis- 
tance” from w, and then ask of a test yg that the further be 6 from w the larger 
be the power £,(6). 

One possible such ordering of the alternatives is that induced by the envelope 
power function. Here the envelope power at @ (Wald [24]) is defined by 


(7.1) 82(6) = sup B,(6) 
ee (a) 


where %(a) is the class of all tests g with Hee(X) < a for all 6 € w. Of two points 
6; , 62 one may then say that 6, is closer to w than 4 , equally close or less close, 
as Ba (6,) is less than, equal to or greater than Bx (00). The distance of @ from w 
is thus measured by the ease with which one can detect that the hypothesis is 
false when @ is the true parameter value. 

When @ lies in a Euclidean space and £,(@) is a continuous function of @ for 
all 6, as is the case in most applications, the condition that the power increase 
with 8% will usually imply that @,(@:) = B,(@2) whenever B2((:) = Bx(02). In 
the case of the general linear hypothesis considered in section 5, for example, 


one would obtain the condition that the power be a function only of ale 
t=1 


where &; = EH(X;). As was shown by P. L. Hsu [3], the standard (likelihood 
ratio) test is uniformly most powerful among all tests satisfying this condition. 
Analogous remarks apply to Hotelling’s T’- problem, and to the hypothesis 
specifying the value of the multiple correlation coefficient. The corresponding 
optimum properties in these cases were proved by Simaika [21]. 

It is interesting to compare the above condition with that of invariance. 
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This comparison yields nothing of interest if the totality of tests is considered. 
We may, however, restrict our attention to tests depending only on a sufficient 
statistic 7. We already know that y(X) and E[g(X) | T] have identical power. 
In order to validate the comparison we wish to make, we state the following 

Lemma. Let T be a sufficient statistic for 0¢€Q, and let G be a group of 1:1 
transformations g on X leaving Q invariant. Then if (x) is invariant under G, 
Ely(X) | t] ts almost invariant under G. 

We can now state the desired comparison in the following 

THEOREM 7.1. Let G be a group of 1:1 transformations on X, let G be the in- 
duced group of transformations on Q, let v(0) be maximal invariant under G, and 
suppose that G leaves w and 2 — w invariant. Suppose further that T is a suffi- 
cient statistic for 2, and that {P¢}, 0 €Q, is boundedly complete. Then a necessary 
and sufficient condition that the power of a test y(T) be a function only of v(@), is 
that y(t) be almost invariant under G. 

This theorem is an immediate extension of some results of Wolfowitz [35]. 

Theorem 7.1 together with the results of section 5 proves that the standard 
tests of the general linear hypothesis, Hotelling’s T°’-problem and the hypothe- 
sis concerning the multiple correlation coefficient possess the optimum property 
that was obtained for these problems by Hsu and Simaika, respectively. The 
method of proof indicated here is due to Wolfowitz [35]. 


8. Most stringent tests. We shall now turn to the third aspect of the theory: 
Optimum properties defined with reference to the whole class of alternatives, 
and attainable with no restrictions imposed on the class of tests. In the present 
section we shall consider the property of stringency. Wald [25] defines a test ¢ 
to be most stringent if it minimizes 


(8.1) sup [82(6) — 6,(8)], 


06€2—w 


where 8% again denotes the envelope power, and 8, the power of ¢. The rationale 
of this definition is clear. The difference 82(8) — 8,(@) measures the amount by 
which the test falls short at the alternative 6 of the power that could be at- 
tained against this particular alternative. A test ¢ is therefore most stringent 
if it minimizes its maximum shortcoming. 

A theory of most stringent tests was developed by Hunt and Stein [5], who 
based it on the notion of invariance. Consider, as in section 5, a group G of 
measurable 1:1 transformations on ¥ leaving the problem invariant. Hunt and 
Stein obtained their results in connection with the following groups of trans- 
formations. 

(i) ge = e+e,-— © <e< ~,2x Aa real variable; 

(ii) gx = ax, 0 < a, x a real variable; 

(iii) gz = ar +c6,0<a,—- © < ec < ©,2 a real variable; 

(iv) the group of orthogonal transformations on a Euclidean space; 

(v) any finite group. 
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TueorEM 8.1. (Hunt and Stein). If G is the direct product of a finite number 
of groups of types (i)-(v), and if G leaves the problem invariant, that is, if G satis- 
fies (5.4), then there exists a most stringent test invariant under G. 

Actually, it is not necessary here to require that G be a direct product. The 
result holds also if the factoring of G is according to normal subgroups, where 
the normal subgroup at each stage and the final factor group are of the types 
mentioned. In the light of this one may omit type (iii) from the list since it has 
a normal subgroup of type (i) with factor group of type (ii). 

The proof of Theorem 8.1 isbased on the following lemma, which has appli- 
cations to many related problems. 

Lemma (Hunt and Stein). If G is a direct product of a finitenumber of groups 
of types (i)—(v) then given any function f over ¥ (0 < f(x) < 1) there exists a func- 
tion F (0 < F(x) < 1) such that F is invariant under G, and 


(8.2) inf | f(gx)e(x) du(x) < / F(x)o(x) du(x) < sup / f(gx)e(x) du(x) 


for all ¢ that are integrable yp. 

It follows from Theorem 8.1 that if there exists a uniformly most powerful 
invariant test, this test is most stringent. In this way Hunt and Stein show, 
for example, (see in this connection section 5), that the likelihood ratio test of 
the general univariate linear hypothesis is most stringent. A question that is 
left open is the uniqueness of such a most stringent test. 

In general, the possibility therefore remains that there might exist another 
most stringent test uniformly more powerful than the invariant one. In certain 
particular cases this possibility can be ruled out by the following considera- 
tion. Suppose that © is a subset of a Euclidean space and that every point of 
w is a limit point of 2 — w. Suppose further that for any test ¢, He(X) is con- 
tinuous in 6. Then clearly, if ¢: is similar of size a for testing w and @z is of size 
< a but not similar, ¢2 can not be uniformly as powerful as ¢; . Hence any test 
that is admissible among all similar tests of size a is also admissible among the 
totality of tests of size S a. Now admissibility among all similar tests is some- 
times not too difficult to prove. For the likelihood ratio test of the general 
linear univariate hypothesis, for example, it is an immediate consequence of 
the properties of this test proved by Wald [23] and Hsu [4]. 

The following alternative method for obtaining most stringent tests is also 
mentioned by Hunt and Stein. 

THEOREM 8.2. (Hunt and Stein). Let Q — w be partitioned into disjoint sub- 
sets 2; such that 8%(0) is constant on each Q; , and let ys be the test that maximizes 
inf Bys(0). Then tf os = ¢ ts independent of 5, ¢ 1s most stringent. 
€u5 


This result may be supplemented by the following method for finding tests 
that maximize inf 6,(@) over a given set of alternatives w (not necessarily 
6 


€@W1 


satisfying the conditions imposed above on the Q,’s). 








16 E. L. LEHMANN 


THEOREM 8.3. Suppose additive classes of sets have been defined over w and w , 
and consider probability measures \ and dy over w and w; . Let the functions fo(x) 


be generalized probability densities with respect to p, so that h(x) = / fo(x) dr(@) 


and h(x) = / fe(x) dd\(0) are again probability densities with respect to yu. Let ¢ 
wy 


be the most powerful test of size a for testing the simple hypothesis H:h against the 
simple alternative h, , and suppose that the power of ¢ against h, is B. Then wf 


Eeo(z) < a forall dew, 


(8.3) 
Ew(x) > 6 forall Oeu, 


y maximizes i“ B,(0) at level of significance a. 


This shila’, when applicable, has the advantage of giving the totality of 
most stringent tests (see in this connection Theorem 3.1) and hence of settling 
the question of admissibility. However, in many applications probability meas- 
ures A, A; with the desired properties do not exist but instead only sequences 
x” | xf”, which satisfy the conditions in the limit. In this case again only the 
weak conclusion is possible: The test obtained is most stringent but has not 
been proved admissible. (For an example in which the analogous method has 
been carried through in detail for an estimation problem, see [22]). 

Actually, the two methods are closely related, as can be seen from the proof 
of the main lemma. In those cases in which there exists a group G giving the 
maximum possible reduction, the group G induces a partition of 2 (through the 
equivalence: 6; ~ 62 if there exists g such that 6. = g6:), just into w and the 
sets 2; . (This is so mainly because, as was shown by Hunt and Stein, the en- 
velope power remains invariant under any transformations that leave the prob- 
lem invariant.) Then the measures X, As over w, 2; respectively, which figure in 
the application of Theorems 8.2 and 8.3, become invariant measures over G 
through the obvious 1:1 mapping from w and the Q,’s respectively to G. Thus 
the second method will allow the strong conclusion when the group G involved 
in the first method possesses a finite invariant measure [types (iv) and (v)] but 
not if any of its factors are of type (i)—(iii). 

To conclude this section we shall give an example where the method of in- 
variance leads only to a partial reduction but where the solution may be com- 
pleted by certain additional considerations. Suppose that (X,,---, Xn) is a 
sample from a normal distribution with mean é and variance o , both unknown, 
and that we wish to find the most stringent test of the hypothesis H: ¢ = 1 
against the alternatives ¢ # 1. Theorem 8.1 reduces the problem to the sta- 
tistic Y = =(X; — X)° , but among the tests of H based on this statistic there 
does not exist a uniformly most powerful one. It may also be shown [8] that 
no further reduction is possible by means of the method of invariance. 

However, one may now consider the problem of finding the most stringent 
test based on Y. (The envelope power function 6*(~, o) that must be used 
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naturally is not the one for Y but that for the original problem.) From an argu- 
ment given in [6] it follows that this test is of the form 


$k, ,k,: reject when Y < ki or > ke, 


where k, , k, are determined by the two conditions 
(i) P(rejection |¢ = 1) = a, 
(ii) sup [32(&, o) — By ,,()] = sup [82(E, 0) — By, ,,(0)]- 


Here 82(é, «) is independent of — and can be obtained from a table of the x’- 
distribution (with n degrees of freedom for o < 1 and n-1 degrees of freedom 
for o > 1 as can be seen from (3.6)). Hence k, and k, can be computed fairly 
easily. 

Another problem that may be treated in this way is the hypothesis of equality 
of variances for two normal samples. If the two samples are of equal size, there 
exists a uniformly most powerful invariant test for a suitable group of trans- 
formations. However, if the sample sizes are different the method of invariance 
reduces the problem only to =(X; — X)’ / 3(Y; — Y)’, and the cut off points 
giving the most stringent test may be determined by an argument analogous 
to that given above. 

This method may be extended to allow determination of most stringent test 
of hypotheses such as H: o, S o S o2. This requires a certain modification 
of Theorem 1 of [6], which is easily obtained. One finds agains that one may 
restrict consideration to a one-parameter family of tests (determined by a 
somewhat different condition than above), and that among these the most 
stringent test is obtained by the analogue of condition (ii) above. 

If should be mentioned that the results of [6] apply also to the hypothesis 
specifying the value of the parameter in a binomial or Poisson distribution. 
This is easily seen since in either case the distributions of 2 are absolutely con- 
tinuous with respect to a common sigma finite measure and since for the ap- 
propriate choice of this measure the generalised density is of the form assumed 
for the density in [6]. Hence in both the binomial and the Poisson case the most 
stringent test is determined by conditions analogous to (i) and (ii) above. 


9. Tests that minimize the maximum loss. In the Neyman-Pearson theory 
one classifies the errors into two kinds: Rejecting the hypothesis when it is 
true, accepting it when it is false. One may however analyze the situation further 
and distinguish, say, between accepting when one or some other alternative is 
true. Thus one is led to introduce the losses that result in a given situation from 
the various possible errors, and to look for a test that, in an appropriate sense, 
minimizes the expected loss. This possibility was mentioned by Neyman and 
Pearson [17], and was taken as the starting point of his general theory by Wald 
(see for example [24]). 

In order to stay within the framework of this exposition we shall here in- 
troduce losses only for the errors of accepting the hypothesis when it is false, 
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while still demanding that the probability of rejection when the hypothesis is 
true should not exceed a. Actually, there are many cases where this seems to 
be a reasonable formulation. For it frequently happens that the two types of 
error entail consequences of such completely different nature that the resulting 
losses cannot be measured on a common scale while usually the different errors 
of the same type are comparable. 

We shall therefore assume that for each 6¢€Q2 — w there is defined a W(8), 
which measures the loss resulting from acceptance of H when @ is true. The 
risk which one runs by using a test 9, when 06¢€Q2 — w is the true parameter 
value is given by the expected loss R,(@) = W(@) E,{1 — o(X)]. When a uni- 
formly most powerful test exists for the hypothesis in question, this test also 
minimizes the expected loss uniformly for @ in Q — w. In the contrary case one 
may again restrict the class of tests in some way, so that within the restricted 
class there exists a uniformly most powerful test, and hence a test that uni- 
formly minimizes the expected loss. Alternatively we may again consider some 
optimum property of the risk function R,(@) as a whole. We shall here consider 
the minimax principle introduced by Wald, and seek a test, which, subject to 
Ewe(X) < e@ for all 6 €w, minimizes 


sup W(0) Edi — o(X)], 


the maximum risk. 

If one introduces losses also for the other type of error it is easy to see that 
for a suitably chosen loss function the definition of minimax expected loss coin- 
cides with that of stringency. It is therefore not surprising that the methods 
of the previous section can be extended to cover the problems considered in 
the present one. (They are actually much more general, and may be applied 
also, for example, to the problem of point estimation, and in fact to the general 
decision problem). 

From the lemma of Hunt and Stein stated in the previous section we im- 
mediately obtain the following extension of Theorem 8.1. 

THEOREM 9.1. Jf G is a group of transformations leaving the hypothesis and 
the class of alternatives invariant, if G can be factored by normal subgroups into 
factors of types (i)-(v), and if the loss function W(6@) is invariant under G, then 
there exists a test p invariant under G and minimizing 


(9.1) sup W(8) Ex{l — 9(X))]. 


It follows that when a uniformly most powerful invariant test exists, this 
test has the property of minimizing the maximum expected loss with respect to 
any invariant loss function. Thus Student’s test, for example, minimizes the 
maximum risk for any loss function that depends only on | é |/c. 

Clearly the second method mentioned in section 8 can be extended in an 
analogous manner if in Theorem 8.2 one replaces the sets 2; by sets over which 
W(6) is constant. 
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Again it may happen that the method of invariance does not reduce the prob- 
lem sufficiently far but that the solution may be completed by other considera- 
tions. Let us once more consider the hypothesis H: ¢ = 1 of the previous section, 
and let us suppose that the loss function has the necessary invariance property, 
so that it is a function only of o but not of the unknown mean. It follows from 
Theorem 9.1 that there exists a test minimizing the maximum risk, which is a 
function only of Y = =(X; — X)’. From [6] it is easily seen that a test Pky ke 
which rejects when Y < k, or > ke, has the desired property if its size is a and 
if in addition 
(9.2) sup W(o)E.[1 — 9(Y)] = sup W(o)E. [1 — 9(Y)]. 

o o> 


It follows that depending on the choice of W(c) the solution may be any member 
of the one-parameter family of tests gx, ,.. of size a. 

Under the conditions of Theorem 9.1, when a uniformly most powerful in- 
variant test exists, this also maximizes the average power for a large class of 
weight functions. If there exists a common finite invariant measure over the 
sets Q; in the sense indicated in section 8, the uniformly most powerful invariant 
test will maximize the average power with this measure as weight function, over 
Q; for all 6. It follows that it maximizes the average power over 2 — w with 
respect to any weight function for which the conditional distribution over each 
Q; is the above invariant measure. If the invariant measure over the Q;’s is not 
finite one can obtain analogous results with respect to a sequence of weight func- 
tions invariant in the limit. The results indicated here are much weaker than 
those obtained for the general linear univariate hypothesis by Wald [23] and 
Hsu [4] under the restriction to similar regions. However their results are no 
longer valid when this restriction is omitted. 


10. Applications to sequential analysis. So far we have restricted considera- 
tion to the case that the hypothesis is to be tested on the basis of a preassigned 
experiment. However, frequently there is available for this purpose a large class 
of experiments, and the selection of an optimum experiment out of this class is 
part of the problem. We shall consider here only the following situation, which 
has recently been studied extensively (see Wald [28, 29]). There is given a se- 
quence of random variables X; , X2, --- whose joint distribution is known to 
belong to some family § = {Pe}, @ « Q; the hypothesis specifies some subfamily: 
6 €w. The X’s are observed one by one, and the decision, whether or not to con- 
tinue experimentation at any given stage, is allowed to depend on the observa- 
tions taken up to that point. Thus the number 7 of observations that will be 
taken is a random variable whose distribution depends on @. Usually, by an 
appropriate choice of stopping rule, there may be effected a considerable saving 
in the expectation of the number of observations necessary to achieve a given 
discrimination between hypothesis and alternatives. The problem is to deter- 
mine the stopping rule and test that minimizes this expectation. 

As we have seen in the previous sections the principal methods for obtaining 








20 E. L. LEHMANN 


optimum tests consist in reducing the problem to that of testing a simple hy- 
pothesis against a simple alternative. This basic problem was solved in the non- 
sequential case by Neyman and Pearson (Theorem 3.1). The solution of the 
much more difficult corresponding sequential problem was obtained for a large 
class of cases by Wald and Wolfowitz [31] in the following 
THEeorEM 10.1. Let X,, X2,--- be identically and independently distributed. 
It is desired to test the hypothesis that the common probability density of the X’s is 
f(x) against the alternative that it is g(x). Given two numbers 0 < a < B < 1, there 
exists a test which, subject to the condition 

P (rejection | f) < a 
(10.1) 

P (rejection | g) > B, 


minimizes simultaneously E;(n) and E,(n), the expected number of observations 
computed for the distributions f and g. This test 1s given in terms of two numbers 
A and B by the following rule. After m observations have been taken, 


g(21) «++ g(%m) 








reject uf tad: Rad A, 
. g (21) eg g(Xm) 
accept uf fa) => fl@a) : 
take another observation if B < g(x) on * 9(&m) « A, 


Here A and B are determined so that condition (10.1) holds with the inequality 
signs replaced by equality. 

So as to be able to treat the various problems considered non-sequentially in 
the previous sections one would have to extend this theorem at least to the case 
that the variables X,, X2,--- form a set of equivalent variables in the sense 
of de Finetti [1]. Instead, we shall here restrict ourselves to a few problems that 
can be solved on the basis of Theorem 10.1. All of the tests discussed below were 
derived from various points of view and some of their properties were discussed 
by Girshick in his important ‘Contributions to the theory of sequential analy- 
sis’, Annals of Math. Stat., vol. 17 (1946) pp. 123-143 and 282-298, and by Wald 
in his basic book on the subject [28]. 

It is convenient here to modify slightly the formulation of the problem of 
hypothesis testing. Let the parameter space Q be divided into three sets, the 
set wo specified by the hypothesis, the class of alternatives w, , and a region of 
indifference 2 — wo — w, where we do not much care whether the hypothesis is 
accepted or rejected (see [28]). Let us denote the sequential random variable 
(X1,-°-:, Xn) by X. Then we wish to determine a sequential test ¢, which, 
subject to 
(10.2) Ego(X) < a for 6 € we 

Euo(X) > B for 0 € wr, 


wee CY Or Nw ae” 


hee 


e 
of 
is 
le 
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minimizes sup E,(n). (Actually, this is a rather artificial formulation. The 
€woto, 


natural requirement is the minimization of sup E,(n) but this is a much more 
662 


difficult problem.) The reduction to the problem of testing a simple hypothesis 
against a simple alternative is achieved by the following obvious extension of 
Theorem 8.3. 


THEOREM 10.2. Let Xo , 1 be distributions over wo , w, respectively, and let ¢ be 
a test, which subject to 


[Bue X)ar0(0) < a 
(10.3) - 


[ Boe(X)an(0) > 8, 
minimizes sup / E,(n) dd;(0). Then if ¢ satisfies (10.2) and 
te{0,1 


(10.4) Eo(n) < sup / E,(n) dd,(8) for all 6 € wo + aw, 
{0,1} 


gy minimizes sup E9(n) subject to (10.2). 


witwe2 

As in section 3 we can make certain trivial applications to problems concerning 
a single real parameter such as testing the hypothesis H: p < pp against the 
alternatives p > pi (po < 1), where p is the probability of success in a binomial 
sequence of trials. In this example condition (10.2) of Theorem 10.2 obviously 
is satisfied when Ao and A, assign probability 1 to po and p; respectively. Hence 
the probability ratio test for testing p = po against p = p, has the desired prop- 
erties, whenever (10.4) holds, that is, whenever £,(n) attains its maximum 
between poy and 7, . 

The following is another example that may be solved in this manner. Let 
X,, X2,---; Yi, Y2,---+ be independently normally distributed, all with 
unit variance and means E(X;) = &, E(Y;) = 7. In order to test the hypothesis 
H:£ > » against the alternatives » — — > 6 where 6 > Ois given, a pair (X, , Y:) 
is observed. If after this observation experimentation continues another pair 
(X2, Y2) is observed, etc. In this case we may take for Ay , A; the distributions 
that assign probability 1 to the parameter points (€,7) = (0, 0) and( -3, *) 


2 
respectively. Then the probability ratio after m observations is given by 


™ 5 2 m ( sy] 
— inn on 
(10.5) Diet |- * 2 (: + ;) 7 i=] y 2 a eg MPO Zyi—Zeed 


ge pete heyi? 





Since the distribution of Y — X depends only on 9 — é, it is easily seen that 
condition (10.2) is satisfied. 

Some further results can be obtained through extension to the sequential case 
of Theorems 8.1 and 9.1. 
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THEOREM 10.3. Suppose that G is of the type described in Theorem 9.1, let Y = 
f(X,, Xe, --- ) be maximal invariant under G, let v(@) be maximal invariant 
under G, and let the set of values of v(0) corresponding to uw and uw, be a and a, re- 


spectively. If among all tests of a) against @ based on Y, the teste minimizes sup - 
0(0) eot+G1 


E4(n) subject to 
Ew(Y) < a if v(0) ea 
Ewl(Y) > B if v(@)ea, , 
then ¢ also minimizes sup Eo(n) among all tests based on the X’s and which satisfy 


wotol 
(10.2). 
As an example consider the problem of testing the hypothesis o < oo against 
the alternatives o > o; (oo < o;) when the X’s are identically, independently 
normally distributed with unknown mean and variance. Since the problem re- 


mains invariant under a common translation of the X’s we can take for Y of 


(10.6) 





the theorem Y = (X. — X,, X3; — Xi, --- ). Equivalently we may take as our 
new sequence of variables (Y; , Ye, --- ) where 
kKXnai — (X oe X 
(10.7) Y; = KXnsy — (Xi + +++ + Xx) 
Vk(k + 1) 
Then Y,, Y2,--- are independently normally distributed with zero mean and 


the same variance as the X’s. Hence the problem reduces to a type which we have 
already considered. The optimum test is based on 


m m+1 - r 2 
> y? , Hit + Xen) 
Y; = > X;- ; 
i=1 > ( m-+1 


It may be worth pointing out that Theorems 3.2, 8.3, 10.2 all are special 
cases of simple results in the general theory of statistical decision functions, of 
which the following is the prototype. (For a detailed treatment of this theory 
see, for example, [30]). Let {Pe}, @Q, be the family of possible distributions of 
a random variable X, and let {5} be a family of decision functions. The loss 
resulting from the use of 6(2) when P, is the true distribution is W[@, 6(x)] and 
the risk function associated with 6 is R;(@) = E,W[é, 6(X)]. Let \ bea probability 


measure over Q, and let 6, be a decision function that minimizes [Ro dd(6). 


Then if X.is such that 
(10.8) R,,(0) < | R;,(¢) ad(t) for all 6 € Q, 


5, minimizes sup (8). 
4 


‘ Proor. Let 6* be any other decision function. Then 
sup Rs,(6) < | %@ ON) [ %o dr(6) Ss sup Rse(6). 
6 


In an analogous manner one can give an extension of Theorems 8.1, 9.1, 10.3. 


——_— = 
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11. Two sided tests considered as 3-decision problems. In a number of 
important special problems the hypothesis specifies the value of a real valued 
parameter or states that this parameter lies in a certain interval, and it is desired 
to test this hypothesis against the obvious two-sided class of alternatives. It 
seems that in nearly any problem of this kind that would arise in practice one 
would want to decide when rejecting the hypothesis, whether the true parameter 
value lies below or above the hypothetical ones. If for example one rejects the 
hypothesis that the means of two normal populations are equal, one usually 
wants to decide which of the two is larger. It would therefore seem most natural 
to formulate such problems as 3-decision problems. 

Problems of this kind, as all problems of hypothesis testing, naturally are 
special cases of the general decision problem formulated by Wald. We shall here 
consider the case that upper bounds are given for the probabilities of certain 
types of errors and thereby obtain a formulation, which is closely analogous to 
the classical formulation of hypothesis testing discussed in this paper, and which 
will allow immediate application of a large portion of the theory discussed here. 

Consider the case that Q is partitioned into 3 parts, w, w; , w. where in a certain 
sense w lies between w; and w. . We wish to test the hypothesis H: 6ew. When we 
reject the hypothesis, we shall reach either decision D, that @¢€w; or decision D» 
that @€w. . Correspondingly we prescribe two positive numbers a, a2 and impose 
the restriction that 


P»(D;) < a) if Oew 4+ We 
P»(Dz) < Qe if G€w aa @). 


(11.1) 


Subject to this condition it is desired to maximize 
P,(D,) for 6 € a; 
P¢(Dz2) for 0 €w.. 
A test will now consist of two non-negative functions ¢; and @» satisfying 
(11.3) oi(x) + ¢o(x) < 1, 


with the convention that when X = z the decision D; will be taken with prob- 
ability ¢.(x) (¢ = 1, 2). 

There is no difficulty concerning the extension of the notions of invariance 
or sufficient statistic, in fact these notions obviously apply to the general deci- 
sion problem. The notion of unbiasedness is extended in the obvious way by the 
condition 


(11.2) 


P4(D,) > ay for 6 € a 
P,(Dz) => a2 for 0 €wWe. 


(11.4) 


One then obtains the following 
THEOREM 11.1. Suppose that for testing the hypothesis H,: 0ew + w. against 
the alternatives 0€w; at level of significance a, , the test ¢; among all unbiased tests 








24 E. L. LEHMANN 


is uniformly most powerful in w + w: and uniformly least powerful in w, , and that 
$2 has the analogous property for testing H, : Oew + w, against Ow, at significance 
level a2 . If o\(x) + 2(x) S 1 for all x, then among all procedures satisfying (11.1) 
and (11.4), the procedure (¢: , $2) uniformly maximizes the probability of a correct 
decision. (If the tests ¢1 , ¢2 take on only the values 0 and 1, the condition ¢:(7) + 
¢2(x) < 1 states that the rejection region of each of the two hypotheses is con- 
tained in the acceptance region of the other.) 

As an example consider the case that X,,--- , X, are independently, nor- 
mally distributed with common mean £ and variance o°. Suppose we wish to 
test the hypothesis that o: S o S oz where o; may equal oz . Then it follows from 
Theorem 11.1 that among all unbiased procedures of level (a; , a2), there exists 
one that maximizes the probability of a correct decision uniformly in &,c. 
This is the procedure under which decision D, or Dz is taken as Z(a, — £)? S hy 
or = k» and the hypothesis is accepted otherwise. Here the k’s are determined by 


P(2(a; = x)? 2 ky | 01) = 


(11.5) 
P(2(a; —_ Z)? = ke | 2) 


a2. 
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SAMPLE CRITERIA FOR TESTING OUTLYING OBSERVATIONS! 


By Frank E. Grusss 


University of Michigan and Ballistic Research Laboratories 


1. Summary. The problem of testing outlying observations, although an old 
one, is of considerable importance in applied statistics. Many and various types 
of significance tests have been proposed by statisticians interested in this field 
of application. In this connection, we bring out in the Historical Comments 
notable advances toward a clear formulation of the problem and important 
points which should be considered in attempting a complete solution. In Section 
4 we state some of the situations the experimental statistician will very likely 
encounter in practice, these considerations being based on experience. For testing 
the significance of the largest observation in a sample of size n from a normal 
population, we propose the statistic 





= \2 
ti Za 
‘2° * 
S?2 = 9 
> (x; — 2) 
i=l 
1 n—l 1 n 
where 2 < 2% < --* <4n,Z, = a, andé = — >> x. 
n—1 fei N j= 


A similar statistic, S?/S’, can be used for testing whether the smallest observa- 
tion is too low. 
It turns out that 


On ill (==*) -1- 1 


S? n-—l s n-—1 











where s° = * B(x — z)’, and T, is the studentized extreme deviation already 


suggested by E. Pearson and C. Chandra Sekar [1] for testing the significance 
of the largest observation. Based on previous work by W. R. Thompson [12], 
Pearson and Chandra Sekar were able to obtain certain percentage points of T, 
without deriving the exact distribution of T,. The exact distribution of st /s 
(or T,,) is apparently derived for the first time by the present author. 

For testing whether the two largest observations are too large we propose the 
statistic 


n—2 
Ss Zz (2; mie Be-a0)° 


a<i.e dad - 1 





S2 eS ee re ee ee Ln—-1,n — pgp vi 


: (x; — 2)” 





1 This paper has been extracted from a thesis approved for the Degree of PhD at the 
University of Michigan. 
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and a similar statistic, Si,./S?, can be used to test the significance of the two 
smallest observations. The probability distributions of the above sample statistics 


TABLE I 





v2 v2 
Table of Percentage Points for = or = 
Percentage Points 
n | 1% 2.5% | 5% | 10% 
3 | 0001 0007 =| .0027 | ~~ .0109 
4 | .0100 0248 | .0494 .0975 
5 | 0442, | = 0808 |. 1270 . 1984 
6 |  .0928 1453 | —.2082 . 2826 
7 | (1447 | 2066 .2696 .3503 
Ss | .1948 .2616 | .3261 .4050 
9 2411 3101 | = 63742, |. 4502 
10 .2831 3526 | .4154 | 4881 
ll 3211 3901 | .4511 | 5204 
12 3554 4232 ~+| (4822 5483 
13 | 3864 4528 5097s 5727 
14 | 14145 | 4792 | 5340 5942 
15 | 4401 | 5030 | .5559 | .6134 
16 | .4634 5246 | 5755 | .6306 
17 | 4848 | 5442 5933. .6461 
18 | 5044 5621 | 6095 | .6601 
19 | (5225 | 5785 | 6243 6730 
20 5393 5937 6379 .6848 
21 .5548 6076 | 6504 6958 
22 5692 6206 |  .6621 7058 
23 5827 6327 | 6728 7151 
24 5953 6439 | 6829 7238 
25 6071 6544 | 6923 .7319 
S’ = >> (a; — 2)? ~where z= Dt 
t=] ‘= 
n—l ; 1 n—l 
Ss. = >» (x; — Z,)° where i, = ane a Zs 
‘1 Pe ‘= 


Si = ~ (x; — %)° where # = nen z ry 


are derived for a normal parent and tables of appropriate percentage points are 
given in this paper (Table I and Table V). Although the efficiencies of the above 
tests have not been completely investigated under various models for outlying 
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observations, it is apparent that the proposed sample criteria have considerable 
intuitive appeal. In deriving the distributions of the sample statistics for testing 
the largest (or smallest) or the two largest (or two smallest) observations, it was 
first necessary to derive the distribution of the difference between the extreme 
observation and the sample mean in terms of the population «. This probability 


TABLE IA 

















Table of Percentage Points for T, = = a or T,= Sou 

n | 1% 2.5% 5% 10% 
3 1.414 1.414 1.412 1.406 
4 | 1.723 1.710 1.689 1.645 
5 | 1.955 1.917 1.869 1.791 
6 2.130 2.067 | 1.996 1.894 
7 2.265 2.182 2.093 1.974 
8 | 2.374 2.273 2 172 2.041 
9 | 2.464 2.349 2.237 2.097 
10 2.540 2.414 2.294 2.146 
11 | 2.606 2.470 2.343 2.190 
12 2.663 2.519 2.387 2.229 
13 | 2.714 2.562 | 2.426 2.264 
14 2.759 2.602 2.461 2.297 
15 | 2.800 2.638 | 2.493 2.326 
16 | 2.837 2.670 | 2.523 2.354 
17 | 2.871 2.701 2.551 2.380 
18 | 2.903 2.728 2.577 2.404 
19 | 2.932 2.754 2.600 2.426 
20 | 2.959 2.778 2.623 2.447 
21 | 2.984 2.801 2.644 2.467 
22 | 3.008 2.823 2.664 2.486 
23 | 3.030 2.843 2.683 2.504 
24 | 3.051 2.862 2.701 2.520 
25 | 3.071 | 2. | 


2.717 2.537 


Mm S22 2°: 


s «2 Te, i? f= + 
j=] N j=l 
distribution was apparently derived first by A. T. McKay [11] who employed 
the method of characteristic functions. The author was not aware of the work of 


i — £ 


McKay when the simplified derivation for the distribution of outlined 





in Section 5 below was worked out by him in the spring of 1945, McKay’s result 
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being called to his attention by C. C. Craig. It has been noted also that K. R. 
Nair [20] worked out independently and published the same derivation of the 
distribution of the extreme minus the mean arrived at by the present author—see 
Biometrika, Vol. 35, May, 1948. We nevertheless include part of this derivation 
in Section 5 below as it was basic to the work in connection with the derivations 
given in Sections 8 and 9. Our table is considerably more extensive than Nair’s 
table of the probability integral of the 2xtreme deviation from the sample mean 
in normal samples, since Nair’s table runs from n = 2 to n = 9, whereas our 
Table II is form = 2 to n = 25. The present work is concluded with some ex- 
amples. 


2. Introduction. Scientific data are collected usually for purposes of interpre- 
tation and if proper use is to be made of the information thus obtained then some 
decision should be reached or some action taken as a result of analyzing the data. 
In many Cases a critical examination of the data collected is necessary in order 
to insure that the results of sampling are representative of the thing or process 
we are examining. Quite frequently our observations do not appear to be con- 
sistent with one another, i.e. the data may seem to display non-homogeneities 
and the group of observations as a whole may not appear to represent a random 
sample from, say, a single normal population or universe. In particular, one or 
more of the observations may have the appearance of being ‘‘outliers” and we 
are interested here in determining once and for all whether such observations 
should be retained in the sample for interpreting results or whether they should 
be regarded as being inconsistent with the remaining observations. It is clear 
that rejection of the “outliers” in a sample will in a great number of cases lead 
to a different course of action than would have been taken had such observations 
been retained in the sample. Actually, the rejection of “outlying” observations 
may be just as much a practical (or common sense) problem as a statistical one 
and sometimes the practical or experimental viewpoint may naturally outweigh 
any statistical contributions. In this connection, the concluding remarks of 
Rider’s survey [2] are pertinent: “In the final analysis it would seem that the 
question of the rejection or the retention of a discordant observation reduces to 
a question of common sense. Certainly the judgment of an experienced observer 
should be allowed considerable influence in reaching a decision. This judgment 
can undoubtedly be aided by the application of one or more tests based on the 
theory of probability, but any test which requires an inordinate amount of calcu- 
lation seems hardly to be worth while, and the testimony of any criterion which 
is based upon a complicated hypothesis should be accepted with extreme cau- 
tion.”’ Hence, it would appear that statistical tests of significance for judging or 
testing ‘‘outliers’”’ come into importance either in supporting doubtful practical 
viewpoints or in providing a basis for action in the absence of sufficient experi- 
mental knowledge of underlying causes in an investigation. Indeed, the latter 
two situations are met quite frequently in practice. 

In the present treatment, we intend to throw some light beyond the work 


Samples of n Observations (Pop. 8.D. as unit) P(ua < u) 


nN 


-05637 
. 11246 
. 16800 
. 22270 


. 27633 
. 32863 
. 37938 
. 42839 
-47548 


. 52050 
56332 
-60386 
64203 
.67780 


-71116 
. 74210 
. 77067 
.79691 
. 82089 


.84270 
- 86244 
. 88021 
89612 
.91031 


- 92290 
- 93401 
94376 
. 95229 
. 95970 


. 96611 
-97162 
- 97635 
- 98038 
- 98379 


- 98667 
- 98909 
-99111 
. 99279 
- 99418 


3 


-00000 
.00309 
.01231 
-02745 
-04817 


-07403 
. 10450 
- 13896 
- 17677 
. 21724 


. 25968 
. 30344 
. 34788 
- 39243 
43656 


47983 
52185 
. 56230 
- 60095 
.63761 


.67214 
- 70448 
. 73459 
. 76248 
- 78817 


.81174 
83325 
85280 
.87049 


- 90075 
.91355 
- 92495 
. 93506 
- 94400 


- 95187 
- 95877 
- 96480 
-97005 
-97461 


4 


-00000 
-00017 
.00134 
-00445 
-01033 


-01966 
-03292 
-05040 
.07218 
.09816 


. 12807 
- 16152 
- 19801 
. 23697 
-27781 


- 31992 
36274 
-40571 
44835 
-49021 


53093 
.57020 
.60777 
64346 
.67713 


. 70870 
. 73812 
76540 
. 79055 
81364 


- 83472 
85390 
.87127 
. 88693 
- 90099 


-91358 
. 92480 
- 93476 
- 94358 
. 95135 





TABLE II 
Probability Integral of the Extreme Minus the Mean, ua , in Normal 


$s 


-00000 
-00001 
-00015 
-00072 
-00221 


-00520 
-01033 
-01820 
-02935 
-04416 


-06288 
-08559 
11219 
. 14246 
. 17602 


21242 
-25113 
- 29160 
-33325 
.37555 


41795 
. 45999 
.50125 
54136 
58001 


-61697 
-65205 
-68513 
-71612 
- 74497 


.77170 
. 79632 
.81890 
83949 
. 85820 


87513 
89037 
90405 
-91628 
- 92716 
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6 


-00000 
-00000 
-00002 
-00012 
-00047 


-00137 
-00324 
-00656 
.01191 
.01982 


-03080 
04525 
-06344 
-08547 
11130 


. 14076 
17353 
- 20920 
24727 
- 28721 


. 32847 
. 37050 
-41276 
- 45478 
49611 


- 53638 
- 57525 
-61249 
64788 
-68129 


-71261 
- 74180 
. 76885 
. 79378 
81664 


83750 
. 85646 
. 87360 
88903 
- 90288 


7 


-00010 


.00036 
-00101 
-00236 
-00482 
-00889 


.01507 
.02390 
-03583 
-05121 
.07030 


.09318 
- 11978 
. 14993 
. 18329 
21945 


25791 
29815 
.33961 
.38173 
-42401 


-46595 
.50712 
-54716 
- 58574 
- 62263 


- 65762 
.69058 
72143 
-75013 
. 77666 


.80107 
82341 
- 84376 
- 86220 
87885 


8 


.00010 
.00032 
-00085 
.00195 
.00398 


.00737 
.01261 
.02022 
-03067 
04437 


-06164 
.08263 
10739 
. 13578 
. 16757 


. 20240 
. 23980 
27927 
- 32025 
. 36220 


.40457 
-44685 
48857 
- 52933 
. 56878 


- 60663 
.64265 
-67668 
. 70862 
. 73839 


- 76597 
- 79139 
.81469 
83593 
85522 


-00003 
-00010 
-00031 
.00079 
-00178 


.00360 
.00665 
.01140 
.01836 
-02800 


.04076 
.05698 
-07688 
- 10055 
.12791 


. 15877 
. 19280 
. 22957 
- 26858 
30931 


.35117 
. 39362 
-43613 
47822 
-51945 


55944 
.59789 
- 63456 
- 66925 
- 70184 


73225 
- 76046 
- 78647 
81032 
83207 
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TABLE II—Continued 

















< este ni ei meee ese ae 
" 

~*~ 2 3 4 5 6 7 8 9 “ 

a _ 2 
2.00 -99532 .97854 .95818 .93682 .91526 .89381 .87264 .85183 |2.00 
2.05 .99626 .98193 .96416 .94536 .92627 #.90721 .88832 .86968 [2.05 
2.10 | .99702 .98483 .969388 .95289 .93605 .91916 .90236 .88574 (2.10 
2.15 .99764 .98731 -97392 .95949 .94468 .92977 .91490 .90012 (2.15 
2.20 | .99814 .98942 .97785 .96527 .95229 .93917 .92604 .91296 /|2.20 
2.25 .99854 .99121 -98125 .97032 .95897 .94746 .93591 .92438 {2.25 
2.30 .99886 .99273 .98418 .97470 .96482 .95476 .94462 .93448 |2.30 
2.35 .99911 -99400 .98669 .97850 .96992 .96114 .95229 .94340 /|2.35 
2.40 . 99931 .99507 .98883 .98178 .97435 .96672 .95900 .95125 |2.40 
2.45 .99947 .99596 .99066 .98461 -97819 .97158 .96487 .95812 {2.45 
2.50 .99959 .99670 .99222 .98703 3 .98151 -97580 .96999 .96412 {2.50 
2.55 .99969 .99732 .993853 .98911 -98436 .97944 .97443 .969385 |2.55 
2.60 .99976 .99782 .99464 .99088 .98681 .98259 .97827 .97389 {2.60 
2.65 .99982 .99824 .99557  .99238 .98891 .98529 .98158 .97781 |2.65 ' 
2.70 .99987 .99858 .99635 .99365 .99070 .98761 .98443 .98120 |2.70 
2.75 .99990 .99886 .99701 .99473  .99223 .98959 .98688 98411 /|2.75 
2.80 .99992 .99909 .99755 .99564 .99352 .99128 .98897 .%o061 {2.80 


| 
| 
2.85 .99994 .99928 .99800 .99640 .99461 .99272 .99075 .98874 |2.85 





2.90 .99996 .99943 .99838  .99704 .99553 99393 99227 .99056 |2.90 
2.95 .99997 .99955 .99868 .99757 .99631 .99496 .99355 .99211 |2.95 
3.00 .99998 .99964 .99894 .99801 99696 .99582 99464 .99342 3.00 
3.05 .99998 .99972 .99914 .99838 .99750 .99655  .99555 .99453 [3.05 
3.10 .99999 .99978 .99931 .99868 .99795 .99716 .99632 .99546 |3.10 
3.15 .99999 .99983 .99945 .99893 .99832 .99766 .99697 .99625 [3.15 
3.20 .99999 .99987 .99956 .99913 .99863 .99808 .99750 .99690 |3.20 
3.25 | 1.00000 .99990 .99965 .99930 .99889 .99843 .99795 .99745 |3.25 
3.30 .99992 .99972 .99944 .99910 .99872 .99832 .99791 [3.30 
3.35 .99994 .99978  .99955 .99927 .99896 .99863 .99829 |3.35 
3.40 .99995 .99983 .99964 .99941 .99916 .99889 .99860 |3.40 
3.45 .99996 99986 .99971 .99953 .99932 .99910 .99886 |3.45 
3.50 .99997 .99989 .99977 .99962 .99945 99927 .99908 |3.50 
3.55 .99998  .99992 .99982 .99970 .99956 .99941 .99925 [3.55 
3.60 .99998  .99994 .99986 .99976 .99965  .99952 .99940 |3.60 
3.65 | .99999 99995 .99989 .99981 .99972 .99962 .99951 |3.65 
3.70 .99999 99996 .99991 .99985 .99977 .99969 .99961 [3.70 
3.75 .99999 .99997 .99993 .99988 .99982 .99976 .99969 |3.75 
3.80 1.00000 .99998 .99995 .99991 .99986 .99981 .99975 [3.80 
3.85 .99998 99996 99993 .99989 .99985 .99980 [3.85 
3.90 .99999 .99997 .99994 .99991 .99988 .99984 - 
3.95 13.95 


-99999  .99997 


-99995 .99993 .99990 .99987 
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10 


-00001 


-00011 
-00032 
-00080 


-00176 
-00351 
-00643 
-01098 
-01766 


-02694 
.03928 
-05503 
.07444 
.09761 


- 12452 
. 15497 
. 18867 
. 22520 
- 26407 


30475 
34666 
- 38924 
-43196 
- 47430 


11 


-00001 


-00013 
-00036 


-00086 
-00185 
00363 
-00657 
.01113 


.01780 
-02707 
-03938 
-05510 
-07448 


.09763 
12454 
. 15503 
. 18879 
. 22542 


- 26442 
30525 
. 34734 
.39011 
- 43302 
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TABLE II—Continued 


. 99999 
. 99999 
1.00000 


- 99998 
- 99999 
. 99999 
. 99999 
- 99999 


. 99999 
1.00000 


13 


-00001 


-00007 


-00021 
-00051 
-00115 
.00235 
-00443 


.00777 
-01285 
-02016 
-03017 
-04334 


-08041 
- 10464 
. 13263 
. 16420 


. 19901 
- 23662 
. 27650 
.31810 
- 36082 


- 99996 
- 99997 
- 99998 
- 99998 
- 99999 


. 99999 
- 99999 
. 99999 
1.00000 


14 


-00001 
-00003 


-00010 
-00027 


-00141 
.00279 


.00514 
-00886 
-01442 
.02232 
-03305 


-04703 


-08595 
11116 
. 14013 


17263 
- 20830 
. 24667 
. 28721 
32934 


- 99995 
- 99996 
- 99997 
- 99997 
- 99998 


- 99998 
- 99999 
- 99999 
- 99999 
. 99999 


1.00000 


15 


-00005 
-00014 
.00037 


-00176 


00339 
-00610 
-01031 
-01652 
-02521 


03687 
-05190 
-07060 
-09315 
- 11957 


. 14973 
. 18336 
- 22005 
. 25931 
- 30058 


16 


-00002 
-00008 
-00021 


-00111 


00224 
-00420 
-00738 
-01222 
-01922 


-02889 
.04169 
-05799 
-07806 
- 10203 


- 12987 
- 16140 
. 19629 
23411 
- 27433 


. 99990 
- 99992 
- 99994 
-99995 
- 99996 


- 99997 
. 99998 
. 99998 
- 99999 
. 99999 


. 99999 
. 99999 
1.00000 


- 11264 
- 14207 
- 17509 
21135 
. 25036 
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TABLE II—Continued 


hy n 

‘ Ky 10 11 12 13 14 15 16 17 “ 
1.50 .51583 .47555 =.43838 =. . 40408 ~=—s 37244) = «.34327)—Sss« «w 31636 =. 29156 1.50 
1.55 .55615 .51726 .48104 .44733 .41595 .38676 .35960 .33434 1.55 
1.60 .59495 .55774 .52282 .49004 .45930 .43046 .40342 .37807 1.60 
1.65 .63196 .59668 .56332 .53178 .50199 .47384 .44726 .42216 1.65 
1.70 .66699 .63380 .60221 .57216 = .54358 .51641 .49058 .46602 1.70 
1.75 -69991 .66892 .63925 .61086 .58370 .55773 .53289 .50915 1.75 
1.80 .73063  .70189 .67424 .64763 .62204 .59744 .57380 .55108 1.80 
1.85 75912 .73264 .70704 .68229 .65838 .63528 .61297 .59144 1.85 
1.90 .78538 .76113 .73758 .71472 .69254 .67102 .65016 .62992 1.90 
1.95 .80945 .78737 .76584 .74486 .72443 .70453 .68516 .66630 1.95 


2.00 .83141 .81140 =. 79183) .77269 = 75399) 73571 =. 71786 =. 70042 = [2.00 
2.05 .85133 .83330 = .81560 .79824 .78121 .76453 .74819 .73218 /|2.05 
2.10 .86932 .85314 .83721 .82155 .80614 .79101 .77614 .76153 {2.10 
2.15 .88550 .87105 .85678 .84271 .82885 .81519 .80174 .78849 {2.15 
2.20 .89998 .88713  .87440 .86183 .84941 .83715 .82505 .81311 {2.20 


2.25 -91290 .90151 .89021 .87902 .86795 .85699 .84616 .83545 {2.25 
2.30 -92437 .91431 .90432 .89441 .88458 .87484 .86518 .85563 2.30 
2.35 .93453 .92568 .91688  .90812 .89943 .89081 .88224 .87375 /2.35 
2.40 .94348 .93572 .92799 .92030 .91264 .90504 .89748 .88997 /|2.40 
2.45 -95134 .94457 =—.93781 = «. 93106 = . 92485 = «. 91766 =. 91101 »= .90440—s (2.45 


2.50 -95823 .95233 .94644 .94055 .93468 .92883 .92300 .91720 {2.50 
2.55 -96424 .95912 .95400 .94887 .94376 .93866 .93357 .92850 {2.55 
2.60 -96948 .96504 .96060 .95616 .95172 .94728 .94285 .93844 /2.60 
2.65 -97401 .97019 .96635 .96251 .95866 .95482 .95098 .94715 |2.65 
2.70 .97793 .97464 .97134 .96802 .96471 .96139 .95807 .95475 /|2.70 


2.75 -98131 .97849 .97565 .97280 .96995 .96709 .96423 .96137 {2.75 
2.80 -98422 .98180 .97937 .97693 .97448 .97203 .96957 .96712 /2.80 
2.85 .98671 .98464 .98257 .98048 .97839 .97629 .97418 .97208 /2.85 
2.90 -98883 .98708  .98531 .98353 .98174 .97995 .97816 .97636 {2.90 
2.95 -99064 .98915 .98765 .98614 .98462 .98309 .98156 .98003 (2.95 


3.00 -99218 .99092 .98965 .98837 .98708 .98578 .98448 .98318 /3.00 
3.05 .99348 .99242 .99134 .99026 .98917 .98807 .98697 .98587 {3.05 
3.10 .99458 .99369 .99278 .99187 .99095 .99002 .98909 .98816 3.10 
3.15 -99551 .99476 .99400 .99323 .99245 .99167 .99089 .99010 (3.15 
3.20 .99628 .99566 .99502 .99437 .99372 .99307 .99241 .99175 |3.20 


3.25 .99694 .99641 .99588 .99534 .99479 .99424 .99369 .99314 [3.25 
3.30 .99748 .99704 .99660 .99615 .99569 .99523 .99477 .99431 (3.30 
3.35 .99793 .99757 .99720 .99682 .99644 .99606 .99568  .99529 (3.35 
3.40 .99831 .99801 .99770 .99739 .99707 .99676 .99644 .99611 {3.40 
3.45 -99862 .99837 .99812 .99786 .99760 .99733 .99707 .99680 





10 


. 99888 
- 99909 
. 99926 
. 99940 
- 99952 


. 99961 
. 99969 
- 99975 
. 99980 
- 99984 


. 99988 
- 99990 
. 99992 
. 99994 
. 99995 


- 99996 
. 99997 
. 99998 
- 99998 
. 99999 


. 99999 
. 99999 
- 99999 
1.00000 


-00001 
-00002 
.00007 
.00018 
-00044 


.00098 
-00199 
-00377 
.00669 
.01118 
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- 99867 
- 99892 
. 99912 
. 99929 
. 99943 


- 99954 
- 99963 
- 99970 
. 99976 
- 99981 


- 99985 
. 99988 
. 99991 
- 99993 
. 99994 


- 99995 
. 99996 
. 99997 
. 99998 
. 99998 


. 99999 
. 99999 
. 99999 
. 99999 
-00000 


.00011 
. 00028 


.00065 
.00137 
-00270 
-00494 
-00853 
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12 


- 99846 
. 99875 
. 99898 
. 99917 
- 99933 


. 99946 
. 99957 
. 99965 
. 99972 
. 99978 


. 99982 
. 99986 
. 99989 
. 99991 
. 99993 


- 99995 
. 99996 
. 99997 
. 99997 
. 99998 


. 99998 
. 99999 
- 99999 
. 99999 
. 99999 


1.00000 


-0019 
.0037 


13 


- 99825 
- 99857 
. 99884 
- 99906 
. 99924 


. 99938 
. 99950 
- 99960 
. 99968 
. 99974 


. 99980 
. 99984 
. 99987 
. 99990 
- 99992 


- 99994 
99995 
. 99996 
- 99997 
. 99998 


. 99998 
. 99999 
- 99999 
. 99999 
. 99999 


1.00000 


0003 
0007 
.0014 
-0027 


14 


. 99803 
. 99839 
. 99869 
- 99894 
- 99914 


. 99930 
. 99944 
99955 
- 99964 
99971 


99977 
- 99982 
- 99985 
- 99988 
.99991 


. 99993 
. 99994 
- 99996 
- 99996 
. 99997 


. 99998 
- 99998 
99999 
. 99999 
. 99999 


. 99999 
1.00000 


. 99781 
- 99821 
- 99854 
. 99881 
. 99904 


- 99922 
- 99937 
. 99949 
- 99959 
. 99967 


- 99974 
. 99979 
. 99983 
. 99987 
. 99990 


. 99992 
. 99993 
- 99995 
. 99996 
. 99997 


. 99998 
- 99998 
. 99998 
. 99999 
. 99999 


. 99999 
. 99999 
1.00000 


.0001 
0003 


-0015 
0029 


16 


- 99759 
. 99803 
. 99839 
. 99869 
. 99894 


. 99914 
. 99930 
. 99944 
- 99955 
. 99964 


. 99971 
.99977 
. 99981 
. 99985 
. 99988 


. 99991 
. 99993 
- 99994 
- 99995 
. 99996 


. 99997 
. 99998 
. 99998 
. 99999 
. 99999 


- 99999 
. 99999 


0001 
0002 
0005 
-0011 
.0022 


. 99737 


17 


99785 
- 99824 
. 99857 
. 99883 


. 99905 
. 99923 
- 99938 


. 99960 


- 99968 
- 99974 
. 99979 
. 99984 
. 99987 


- 99990 
- 99992 
. 99993 
- 99995 
99996 


- 99997 
. 99997 
. 99998 
- 99998 
. 99999 


-0001 
0001 


0008 
.0017 
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2.70 


2.75 
2.80 
2.85 
2.90 
2.95 


.01775 
-02690 
-03911 
-05481 
-07428 


-09769 
12504 
- 15618 
- 19080 
. 22848 


. 26869 
.31084 
- 35430 
39845 
- 44269 


48645 
52924 
-57065 
-61031 
64796 


68340 
-71650 
74719 
- 77545 
80132 


82486 
84616 
86533 
- 88251 
89783 


-91142 
92345 
- 93404 
- 94332 
-95144 


. 95852 
. 96466 
- 96997 
97456 
- 97850 


19 


.01391 
-02161 
-03212 
-04592 
-06338 


08472 
-11005 
. 13930 
- 17225 
- 20851 


. 24761 
. 28899 
. 33202 
- 37607 
-42052 


-46476 
- 50827 
-55058 
-59130 
-63011 


.66678 
.70114 
73311 
- 76262 
- 78971 


-81440 
- 83679 
. 85699 
87511 
.89129 


. 90568 
91842 
- 92965 
-93951 
-94814 


- 95567 
. 96220 
- 96787 
-97275 
- 97696 
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TABLE II—Continued 
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-0109 
.0174 
.0264 
-0385 
.0541 


0735 
0969 
. 1242 
- 1555 
. 1903 


. 2282 
. 2687 
3111 
3549 
3994 


4881 
.5312 
.5729 
-6127 


-6861 
7193 
- 7500 
7782 


-8041 
8275 
. 8487 
8678 
8848 


-9134 
9253 
9357 
-9448 


- 9528 
- 9598 
- 9658 
.9710 
9754 


21 


-0085 
-0139 
-0217 
0322 
-0461 


-0637 
-0853 
1108 
. 1404 
- 1736 


-2103 
. 2498 
. 2916 
3349 
3794 


4242 
4687 
-5125 
.5549 
- 5958 


6348 
.6714 
. 7058 
7375 
. 7670 


- 7938 
.8184 
8405 
-8605 
. 8784 


_- 8943 


-9209 
.9319 
.9416 


. 9500 
9573 
- 9637 
- 9692 
9739 


22 


.0067 
-0112 
-0178 
.0270 
.0394 


-0553 
-0750 


- 1267 
. 1585 


. 1938 
. 2322 
. 2732 
.3162 
. 3604 


-4053 
- 4502 
-4945 
5377 
-5794 


-6193 
.6570 
6924 


- 7558 


- 7838 
8093 
8324 
. 8533 
.8720 


8887 
9035 
-9166 
9282 
- 9382 


9472 
9549 
-9616 
9674 
-9724 


23 


-0052 


-0146 
.0226 
-0336 


.0479 


.0882 
1144 
. 1446 


. 1786 
2159 


. 2984 
3424 


3872 
-4323 
4771 


- 5634 


6042 
-6429 
.6793 
. 7133 
- 7448 


7738 


8244 
8461 
. 8656 


. 8831 
8985 
-9123 
9244 
-9351 


9444 
9524 
-9595 


.9709 


24 
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3.00 . 98187 
3.05 . 98476 
3.10 | .98722 
3.15 - 98931 
3.20 .99108 
3.25 . 99258 
3.30 . 99384 
3.35 | .99490 
3.40 .99579 
3.45 | .99653 
3.50 | .99715 
3.55 | .99766 
3.60 | .99809 
3.65 | .99844 
3.70 | .99873 
3.75 | .99897 
3.80 | .99917 
3.85 | .99933 
3.90 | .99946 
3.95 | .99956 
4.00 | .99965 
4.05 | .99972 
4.10 | .99977 
4.15 | .99982 
4.20 | .99986 
4.25 | .99989 
4.30 -99991 
4.35 | .99993 
4.40 | .99994 
4.45 | .99995 
4.50 | .99996 
4.55 | .99997 
4.60 . 99998 
4.65 | .99998 
4.70 | .99998 
4.75 -99999 
4.80 | .99999 
4.85 . 99999 
4.90 /|1.00000 
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. 98057 
- 98365 
- 98629 
- 98852 
- 99042 


- 99202 
- 99337 
-99451 
99546 
- 99626 


- 99693 
-99748 
- 99794 
- 99832 
- 99863 


. 99889 
- 99910 
- 99927 
.99941 
- 99953 


- 99962 
. 99969 
-99975 
- 99980 
- 99984 


- 99987 
. 99990 
- 99992 
- 99994 
- 99995 


- 99996 
99997 
- 99997 
- 99998 
- 99998 


- 99998 
- 99999 
- 99999 
1.00000 


TABLE II—Continued 


20 


-9793 
- 9825 
9853 
-9877 
. 9898 


-9915 
. 9929 
.9941 
-9951 
. 9960 


. 9967 
-9973 
.9978 
- 9982 
. 9985 


- 9988 
-9990 
- 9992 
9994 
-9995 


- 9996 
- 9997 
- 9997 
- 9998 
- 9998 


- 9999 
. 9999 
. 9999 
1.0000 


21 


- 9780 
.9814 


. 9869 
9891 


. 9909 
- 9924 
. 9937 
. 9948 
- 9957 


-9965 
9971 
. 9976 
.9981 
. 9984 


- 9987 
- 9990 
- 9992 
- 9993 
-9995 


- 9996 
- 9996 
.9997 
-9998 
9998 


- 9999 
-9999 
. 9999 
. 9999 


1.0000 


22 


- 9767 
- 9803 
- 9835 
- 9862 
- 9884 


- 9904 
- 9920 
9933 
-9945 
. 9955 


-9963 
- 9969 
-9975 
. 9979 
9983 


- 9986 
- 9989 
-9991 
9994 
.9995 
9997 
-9998 
- 9998 
. 9999 
- 9999 
9999 


1.0000 








37 
23 24 25 “ 
-9753 .9741 .9728 |3.00 
-9793 -9781 .9771 |3.05 
9826 -9816 .9807 |3.10 
- 9853 -9846 .9838 (3.15 
9878 .9871 .9865 |3.20 
. 9898 .9893 .9887 (3.25 
.9915 -9911 .9906 (3.30 
-9930 -9926 .9922 |3.35 
- 9942 -9939 .9936 /|3.40 
- 9952 -9949 .9947 |3.45 
.9961 .9958 .9956 /3.50 
- 9968 -9966 .9964 /3.55 
-9973 .9972 .9971 |3.60 
9978 -9977 .9976 (3.65 
-9982 .9982 .9981 |3.70 
- 9986 -9985 .9984 |3.75 
9988 -9988  .9988 {3.80 
-9991 -9990 .9990 /3.85 
9993 -9992 .9992 {3.90 
-9994 -9994 .9994 |3.95 
.9995 -9995 .9995 (4.00 
-9996 -9996 .9996 |4.05 
-9997 -9997  .9997 /|4.10 
-9998 -9998  .9998 |4.15 
-9998 -9998  .9998 |4.20 
-9999 -9999 .9999 /4.25 
9999 -9999 .9999 |4.30 
. 9999 -9999 .9999 /4.35 
-9999 -9999 .9999 |4.40 
- 9999 -9999 .9999 |4.45 
1.0000 -9999 .9999 |4.50 
1.0000 1.0000 /4.55 
4.60 
4.65 
4.70 
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that has already been done [1], [2], [3], [4], [11], [12], [20] on the problem of test- 
ing outlying observations statistically and to see just where our contributions 
fit into this corner of mathematical statistics. First, however, we give a very 
brief history of the problem. 


3. Historical comments. A survey of statistical literature indicates that the 
problem of testing the significance of outlying observations received considerable 
attention prior to 1937. Since this date, however, published literature on the 
subject seems to have been unusually scant—perhaps because of inherent diffi- 
culties in the problem as pointed out by E. 8. Pearson and C. Chandra Sekar [1]. 
These authors made some important contributions to the problem of outlying 
observations by bringing clearly into the foreground the concept of efficiency of 
tests which may be used in view of admissible alternative hypotheses. 

In 1933, P. R. Rider [2] published a rather comprehensive survey of work on 
the problem of testing the significance of outlying observations up to that date. 
The test criteria surveyed by Rider appear to impose as an initial condition that 
the standard deviation, ¢, of the population from which the items were drawn 
should be known accurately. In connection with such tests requiring accurate 
knowledge of ¢, we mention (1) Irwin’s criteria [3] which utilize the difference 
between the first two individuals or the difference between the second and third 
individuals in random samples from a normal population and (2) the range” or 
maximum dispersion [4], [5], [6], [7], [8], [9], [10], [18] of a sample which has been 
advocated by “Student” [4] and others for testing the significance of outlying 
observations. We remark further that a natural statistic to use for testing an 
“outlier” is the difference between such an extreme observation and the sample 
mean. In 1935, McKay [11] published a note on the distribution of the last- 
mentioned statistic and by means of a rather elaborate procedure obtained a 
recurrence relation between the distribution of the extreme minus the mean in 
samples of n from a normal universe and the distribution of this statistic in 
samples of n — 1 from the same parent. McKay gave also an approximate expres- 
sion for the upper percentage points of the distribution but did not tabulate the 
exact distribution due to the complicity of the multiple integrals involved. 
McKay pointed out that if K, denotes the p-th semi-invariant of the distribution 
of xn — & (where zx, is the largest observation) and Kj, refers similarly to the 


oe a a a a 4 and K, = K’, (p > 3 


where p = E(x;). Nair [20] has tabulated the distribution of the difference be- 
tween the extreme and sample mean forn = 2 ton = 9. 

Under certain circumstances, accurate knowledge concerning o may be avail- 
able as, for example, in using “‘daily control’ tests [4], [18] the population stand- 
ard deviation may be estimated in some cases with sufficient precision from past 

? The derivation for the exact distribution of the range is given in reference [9], 1942; 
however, Dr. L. S. Dederick of the Ballistic Research Laboratory also derived the exact 
distribution of the range in an unpublished Aberdeen Proving Ground Report (1926). 
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data. In general, however, an accurate estimate of ¢ may not be available and 
it becomes necessary to estimate the population standard deviation from the 
single sample involved or ‘‘Studentize” [18], [20] the statistic to be used, thus 
providing a true measure of the risks involved in the significance test advocated 
for testing outlying observations. W. R. Thompson [12] apparently had this very 
point in mind when he devised an exact test in his paper, ‘On a Criterion for 
the Rejection of Observations and the Distribution of the Ratio of the Deviation 


to the Sample Standard Deviation,’ which appeared in 1935. Thompson showed 
that if 


T; = “=? 


1 2 - a2 ' ; : 
where = = - a;,8 = — >> (a; — %)’ and 2; is an observation selected arbi- 
t=] 


3) — 


trarily from a random sample of n items drawn from a normal parent, then the 
probability density function of 


is given by ‘“‘Student’s” ¢-distribution with f = n — 2 degrees of freedom. 

Pearson and Chandra Sekar have given a rather comprehensive study of 
Thompson’s criterion in an interesting and important paper [1] which appeared 
in 19386. They discussed also some very important viewpoints which should be 
taken into consideration when dealing with the problem of testing outlying 
observations. By setting up alternatives to the null-hypothesis Ho that all items 
in the sample come from the same population, Pearson and Chandra Sekar point 
out that if only one of the observations actually came from a population with 
divergent mean, then Thompson’s criterion would be very useful, whereas if 
two or more of the observations are truly outlying then the criterion | x; — Z| > 
Tos may be quite ineffective, particularly if the sample contains less than about 
30 or 40 observations. 

A point of major interest concerning Thompson’s work nevertheless is that he 
proposed an exact test for the hypothesis that all of the observations came from 
the same normal population. With regard to the use of an arbitrary observation 
in Thompson’s test, however, it should be borne in mind that the problem of 
finding the probability that an arbitrary observation will be outlying is different 
from that of finding the probability that a particular observation (the largest, 
for example) will be outlying with respect to the other n — 1 observations of 
the sample. 

As a final point concerning the paper of Pearson and Chandra Sekar [1], we 
see that for the n values of 7’; arranged in order of magnitude taking account of 
sign, say 


r. =. Bead =. 
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then 
ro > p? > ro saan yo 


The above authors show that the form of the total distribution of all the 7; 
at its extremes depend only on 7 and 7”. This is because for some combina- 
tions of sample size and percentage points the algebraic upper limit for 7 and 
algebraic lower limit for 7” do not extend into the “tails” of the total distri- 
bution. Hence, the following probability law holds for T® when T” > the 
algebraic maximum of 7: 


p(T} = Np(T). 
Likewise, 
p{T”} = Np(T) 


for T™ < algebraic minimum of 7"~”. Therefore, Pearson and Chandra Sekar 


were able to use Thompson’s table [12] and give (for some sample sizes) upper 
po ws vi 


—* for the highest observation and lower proba- 


probability limits for : 


om vi 


bility limits for = *i —* for the lowest observation without actually obtain- 


ing the exact probability distribution of 7 and T. Hence, the appearance of 
the table of percentage points on page 318 of their paper [1] was a substantial 
contribution to the problem of testing outlying observations since an exact test 
for the significance of a single outlying observation was provided for the case 
where an accurate estimate of ¢ is not available. (The exact distribution of 7” 
or 7” is derived later in this work.) 

With the above highlights df historical background in mind, we turn now to a 
consideration of the types of problems the experimenter may be faced with in 
testing ‘outlying’ observations. 


4. Statement of hypotheses in tests of outliers. Once the sample results of 
an experiment are available, the practicing statistician may be confronted with 
one or more of the following distinct situations as regards discordant observa- 
tions: (2) To begin with, a very frequent or perhaps prevalent situation is that 
either the greatest observation or the least observation in a sample may have 
the appearance of belonging to a different population than the one from which 
the remaining observations were drawn. Here we are confronted with tests for 
a single outlying observation. (b) Then again, both the largest and the smallest 
observations may appear to be “different”? from the remaining items in the 
sample. Here we are interested in testing the hypothesis that both the largest 
and the smallest observations are truly “outliers.” (c) Another frequent situation 
is that either the two largest or the two smallest observations may have the 
appearance of being discordant. Here we are interested in reaching a decision 
as to whether we should reject the two largest or the two smallest observations 
as not being representative of the thing we are sampling. 


weer 


eV7" 
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As to why the discordant observations in a sample may be outliers, this may 
be due to errors of measurement in which case we would naturally want to reject 
or at least “correct” such observations. On the other hand, it may be that the 
population we are sampling is not homogeneous in the uni-modal sense and it 
will consequently be desirable to know this so that we may carry out further 
development work on our product if possible or desirable. 

Although there may be many models for outliers, we believe that an important 
practical case involves the situation where all the observations in the sample 
may be subject to the same standard error, whereas it may happen that the 
largest or smallest observations result from shifts in level. For example, if one 
observation appears unusually high compared to the others in the sample we 
may want to consider the hypothesis that all the observations come from a 
normal parent with mean yp and standard deviation o as against the alternative 
hypothesis that the largest observation comes from a normal population with 
mean uw + Ao (A > O) and standard deviation o, whereas the remaining observa- 
tions are from N(y, o). 

Another case involves the situation where the largest and/or smallest obser- 
vations may be from N(u, Ac), A > 1, whereas the remaining observations of 
the sample are from the normal parent N (uy, oc). 

Although we have not investigated the power of the tests proposed herein for 
various models, it is believed that the exact test of Section 8 for the largest (or 
smallest) observation and the test of Section 9 for the two largest (or two small- 
est) observations possess considerable intuitive appeal for the practical situations 
described above.’ 


5. Distribution of the difference between the extreme and mean in samples 
of n from a normal population. The simultaneous density function of n inde- 
pendent observations from a normal parent with zero mean and variance o° 
which are arranged in order of magnitude is given by 


n! 


(1) GF (x, , 2% ,°°* »2n) = TOF Nn OX meee dx, dr, --- dx 
; ly »+2, »“n (\/2x0)" *P ay ‘ 1 2 n 


t=] 


subject to 71 < m2 < +--+ aq. 


Since 


n n—-l 

> (e; — 2)? = —“— (, — 8)? + D (we — &)° 
i=1 n—l i=] 

where 


1 n—1l 
z= — 2; 
n om 1 a ay 
The author is indebted to J. W. Tukey and 8. S. Wilks for calling attention to an in- 
correct distribution function in the originally submitted manuscript on which several 
yet-to-be proved or disproved statements concerning optimum properties of statistics in 
this paper were based. 
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then 
eae n _ g\? n— 1 _ sy 
2, ti = ne + 7 Gn £) i. 5 Gn E,) 
2 
(2) + =? (tn—2 er os + =e + S t3 = 2 S75 + = + *) 
n—3 9 3 
2 ~ 
+7 (#- 24) 
where 
t J - Zi, ete 
n,n—l ia an 2 ~~ iy ° 


and consequently we find that we are particularly interested in the following 
Helmert orthogonal transformation: 


V2:lom = —%1 + 22, 
V3-2on3 


—% — fe + 2m, 


(3) 
V n(n — 1)omn =m —2%— te i3—- Hm tm ee 
— +++ tat (n—1)r0, 
Vnomen =U + artatates tates tana t an. 


The above transformation will lead to the distribution of the difference be- 
tween the extreme and sample mean in terms of the unknown population o for 
samples of n from a normal parent. Since, however, K. R. Nair (Biometrika, 
May, 1948) has already published the details independently, we will only re- 
cord here for later reference that the density function of m2, 3, --- , mn (after 
integrating mn41 over —© < mui < +) is 

n! 


! le 2 
= (\/2n)" exp | - 3 > | dnz dns --- dnn 


where the »; are restricted by the relations 


~ r 
(5) 0 > m > 0, fs n 2 Nr-1- 


Upon making the transformations 


(6) —— ee — = == = Ur; (r ee 2, 3, aor n), 


r o 


(4) dF (nz, mee 7° Nn) 


defining 


I 


(7) F,(u) = [ dF(u,) = probability uz < u, 
0 
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and integrating the wu, over their appropriate ranges we find the cumulative 
probability integrals of the extreme deviation from the sample mean (in terms 
of the population co) for n = 2, 3, --- to be 


= - 1 aid 2 2 rr angS 
F.(u) = 2 2 | = 1 dp = = | a ae, 
(u) Vv 0 V2r Vx Jo 
a well-known result, where for n = 2, x is either the sample standard deviation, 


the difference between the extreme and sample mean, the mean deviation or the 
semi-range. 


u l 
a ee ee 
—— | \/ 2m e F,($x) dz, 


n Vn "2 —}((n)/(n—1)z?) ( n ) 
PAs) = ———— — F,~ x}dzx. 
” Vn — 10 VQ ; : n-1 


This is equivalent to the result of McKay (11), although the derivation in- 
dicated is a considerably simpler one. 


Now F,_:(u) increases from 0 to 1 as u increases from 0 to «©. Hence, if 





n : ; : — n ; 
Fy-1 { - u} is practically unity, i.e. for ———- wu numerically large, the 
n-l1 ; n-—1l1 . 


upper percentage points of u, may be approximated by the normal integral 


9 


n a l1 en Vn 
nmin X _—_ — —_—______. a ce n 
Jaf en | i . 


n - f° 
~~. exp | — =| dt. 
V 24 _— P | | 


Formula (9) was found to be particularly useful in checking the higher prob- 
abilities in Table II. 


The cumulative distribution functions (8) may be put into another form by 
setting 


I 


| ” AF (us) 
(9) ” 


Then F,,(u) becomes 


F.(u) = a f / f ” i - c c 


ls 4 
exp | > ™ = | nd dog. 


9 iG — 1) 


(10) 
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Define the following functions: 
A, (x) = 1, 


H(z) = V2 (yea E . i H(t) dt, 


H,(z) = j/ —— [ ee | - ; . a H,-1(t) dt. 


Hence, the probability that the difference between the extreme and the mean 
in samples of n from a normal population is less than wo is given by the alterna- 
tive forms 


P{un < uc} = F,(u) = A,(nu). 


Of course, H,(nu) — 1 asu — o for any given n. 

In the November 1945 issue of Biometrika, Godwin [13] arrived at a series 
of functions closely related to the H,(x) in connection with the distribution of 
the mean deviation in samples of n from a normal parent. In Godwin’s work, 
he defines functions G,(x) which are related to the H,(x) by the equation 


(20) Hry(z) = G,(z). 


The G,(x) functions were computed by H. O. Hartley [15] for r = 2, 3,---9 
only. Computations on the functions F,(u), i.e. (8), were well under way by 
the author before Godwin’s article on the mean deviation appeared. The H,(x) 
or G,(x) can be used to obtain both the distribution of the difference between 
the extreme and mean and also the probability integral of the mean deviation. 
Indeed, it is believed that these functions may have a useful place in tabulating 
distributions of order statistics. 


6. Tabulation of the distribution function, F,,(u). 

The tabulation of the F,(u) with ordinary computing equipment is quite 
laborious. However, a table model computing machine was used initially to 
obtain the F,,(u) for n = 2 tom = 15 using formulae (8) and a numerical quad- 
rature process. ; 

In view of the possible general usefulness of the H,(x), these functions were 
also computed as a sample problem on a high-speed computing device, the 
ENIAC (Electronic Numerical Integrator and Computor) of the Ballistic Re- 


4 The author suggested the problem of tabulating the functions F,,(u) or H,(nu) to the 
Computing Laboratory of the Ballistic Research Laboratories in the fall of 1945; however, 
due to problems of higher priority, these functions were not computed on the ENIAC 
until March, 1948. 
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search Laboratories of the Ordnance Department.’ In this connection, the H,(u) 
have been computed for r = 2 tor = 25 at the Ballistic Research Laboratories. 
For n = 2, the functions H,(x) were computed to nine decimal places of ac- 
curacy on the ENIAC and at n = 25 about five decimal places of accuracy 
were obtained. In Table II we have tabulated F,(u) or H,(nu), i.e. the prob- 


TABLE III 
Percentage Points for Extreme Minus Mean 





n 90% 95% 99% 99.5% 





2 1.163 1.386 1.821 1.985 
3 1.497 1.738 2.215 2.396 
4 1.696 1.941 2.431 2.618 
5 | 1.835 2.080 2.574 2.764 
6 1.939 2.184 2.679 2.870 
7 2.022 2.267 2.761 2.952 
8 2.091 2.334 2.828 3.019 
9 | 2.150 2.392 2.884 3.074 

10 | 2.200 2.441 2.931 3.122 
11 |) 2.245 2.484 2.973 3.163 
12 2.284 2.523 3.010 3.199 
13 2.320 2.557 3.043 3.232 
14 2.352 2.589 3.072 3.261 
15 2.382 2.617 3.099 3.287 
16 2.409 2.644 3.124 3.312 
17 2.434 2.668 3.147 3.334 
18 2.458 2.691 3.168 3.355 
19 2.480 2.712 3.188 3.375 
20 2.500 2.732 3.207 3.393 
21 2.519 2.750 3.224 3.409 
22 2.538 2.768 3.240 3.425 
23 2.555 2.784 3.255 3.439 
24 2.571 2.800 3.269 3.453 
25 2.587 2.815 3.282 3.465 


ability integral of the extreme minus the mean, at intervals of uw = .05c. Values 
computed on the table model computing machine agreed to five decimal places 
at n = 15 with values from the ENIAC. Percentage Points of the distribution 
are given in Table III and the moment constants may be found in Table IV. 
Moment constants for n = 60, 100, 200, 500 and 1000 were obtained by use 
of McKay’s formulae [11] (which relate the semi-invariants of z, — Z% with 
those of z,) and Tippetts moments [5] for the largest observation 2, . 
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TABLE IV 
M Moment Const Constants for Extreme Minus Me ean 
Std. 

n Mean Dev. a, x4 
2 . 5642 .4263 .9953 3.8692 
3 . 8463 .4755 . 8296 3.7135 
4 1.0294 .4916 . 7675 3.6717 
5 1.1630 .4974 .7372 3.6560 
6 1.2672 .4993 .7165 3.6511 
7 1.3522 .4991 .7042 3.6503 
8 1.4236 .4979 .6959 3.6518 
9 1.4850 .4962 .6900 3.6546 
10 1.5388 .4943 .6857 3.6582 
11 1.5864 .4923 . 6827 3.6622 
12 1.6292 .4902 .6804 3.6663 
13 1.6680 .4881 .6788 3.6705 
14 1.7034 .4861 .6777 3.6746 
15 1.7359 .4841 .6770 3.6787 
20 1.867 475 .677 3.700 
60 2.319 .436 .699 3.801 
100 2.508 .418 .712 3.855 
200 2.746 .395 .737 3.932 
500 | 3.037 .368 771 4.033 
1000 | 3.241 350 794 4.105 


7. Relation between the distribution of the largest minus the mean of all 
n observations and the largest minus the mean of the remaining n-1 items. 
The following relation is of interest concerning these two statistics: 


Let 
i a ss 2S 
nm n n 
= 2 . 
— = 1) fn — Bm Bem +e — Sea}. 
Let 
a on, ~ SS coe sb Lao 
n-—1 
hi tins {(m — 1) an — By — %2 — +++ — Snr}. 
oe | . 
Hence, 
n 
Vn = Un 
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or 





Pls <1) = P(—* sm St) = Plu <*— ab, 
n-1 nN 


i.e. the probability integral of the largest minus the mean of the other observa- 
tions may be obtained by interpolation on the distribution of the largest minus 
the mean of all n items in the sample. 


8. The distribution of S;,/S? and Si/S*. As indicated in the Summary, we pro- 
posed the sample criterion 





n—1 

> (2: — &,)° n—1 
i a aa a 
S n-—1 {<1 


a (a; — 2)’ 


for testing the significance of the largest observation and the criterion 


n 


s? } (x; — %)° 





© pian tt 0 wien Sm 


for testing whether the smallest observation is outlying. We now find the prob- 
ability distribution of S%,/S’; hence, also that of S?/S’. 
Returning to the density function 


n! le ; 
dF (ne 9389 °°? >In) = Way er| -} 3 | an dns non dna 
of Section 5, we make the polar transformation 
m2 = 7T sin 6, sin On, --- sin 6 sin 63, 


ns = 7 sin 6, SiN On-1 --- sin 6 Cos 63, 


m = Tr sin 6, Sin 0,1 --- cos &, 


(11) 
Nn—1 = T SID 0, COS On-4, 
"Nn = 7 COS 4,. 
Now 
wn = L@-2=7 
t=2 t=] 
and 


n—l n—-1 . . 
> n= Dd (a; — &,)’ = r sin’. 
t=] 


t=2 
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Hence, 

n—1 

7 (x; as En) 
i=1 

} om (x; — 2)’ 


t=1 


The Jacobian of the above transformation is 


._ 2 
sin’ 6, = 


n—2 


= aed 5: awl a oe ° 
r” sin” “6, sin” “0,1 «++ Sin” 06 sin” 6, sin 4%, 


and sincee0 <r < 











dF (6, , On-1,°** , 05, 04, 83) 
_ = en gerry (>) sin” * 6, --- sin? 5 Sin 0, d0, «++ d0s d0, dds. 
Since the restrictions on the 7; are 
m > 0, av ze-d, r23, 
we have 
tan 0, COS 0,1 = = : n>4, 
or 
tan On < 4/ "5 see On-1, n>4, 
and 
0<&<5. 
Thus, letting K, = aun “rr (: : ') , we see that 


«/3 l3 ln—2 Ino1 
(13) K, | | vee [ sin” * 6, --- sin’ 05 sin 0; d0, --- d0,d6; = 1, 
0 0 0 0 


where J, = tan” y/' - = i sec 6,. 


Upon reversing the order of integration (the variable limits are monotonic) we 
get forn = 3 





«/3 
K; | dé; = Rs 
0 


so that 


6 
(14) P(6; < 6) = Ks | dt O0<6<M; = tan" 341. 
0 


| eeeeeamettone Seo 


eine 
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When n = 4, we obtain 


m4 «/3 M, a/3 
K, [ | sin 6, dé; dé, + K, [ [ sin & dh dy = 1 
0 0 


m, 14 


where 





mM, = tan" 4/ —?,M, = tan /r(r — 2) and L, = sec” i" = 2 tan 6,, 





r 
so that 

K, f° 1, /4 
(15a) P(@ < @) = > [ sin 6, dO, when 0 < 6 < m = tan 3 

Kz Jo 2 
and 

K, m, : 6 «/3 
(15b) P(@ < 0) = [ sin 0, do, + K; [ / sin 0, d0, dd, 

340 mye Yl4 


when m, = tan 3 <0 <M, = tan’ V/4-2. 


When n = 5, we get, 


me pm px/3 me pM pt 13 
K; [ [ [ sin? 6; sin 0, dds d0, d0;-+ Ke [ [ / sin’ 6; sin 0, dé; dO, db, 
0 Jo Jo 0 be 


m4 


Ms pM, pxl3 
+ Ks [ / / sin’ 65 sin 6, d0; d0, dé, = 1 
ms Ls 14 


(where Ll, = sec” 3 tan @ is to be taken as 0 whenever @& < m = 


tan” (4) so that 


6 
(16a) P(6s; < 6) = _ [ sin’ 65 ds when 0 < 6 < m; = tan” i? 
4 40 


and 


K ms 6 M, «/3 
(16b) P(@ < 6) = [ sin? 6, dé; + Ks [ [ [ sin? 0, sin 6, d0; dO, dds 
K, 0 me “Ls I4 


= 
where m, = tan” 2 6< M; = tan” V5°3, 


and we put Ly = sec” 2 tan 6, = 0 whenever @ < m, = tan” 3 , 
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For a sample of n items 


P(o, < 0) = — : i) 
) 








i. am 
(17a) vay G3 
ate? -? 5 af 
= 3 Tan ( 5 3) when 0 < 6 < tan 5 
and 
—21 
P(6, < 0) = 5 Encn—a) (257.3) 
(17b) 6 Ma Mn—2 rl3 
+ K, | / / | sin”* 6, --- sin 0,d0;d0 --- d, 
mn ~ La Ln-1 1s 
for 


me ta o/s SS Me = tw Vale 


where I,(p, q) is K. Pearson’s Incomplete Beta Function Ratio [19]. It is to be 
understood in (17) that 


L; = sec” of}? tan 0; for 7 = 4,5,---,n—1 


is to be taken as zero when 6; < tan / 3° 





Percentage points for the sample statistic 


n—l 


ge 7 (a1 — En)” 


sin’ 6, = = = = 
Zz. (x11 — &) 
t=] 


or the statistic S;}/S_ are given in Table I and were obtained by inverse inter- 
polation on the tabulation of the probability integral (17) above. Percentage 


points for the Pearson and Chandra Sekar statistics, T, = ao or 
T, = ——* (where s* = ~ >> (x; — 2)*), are given in Table IA. The statistics 
S*./S’ and T,, are related by the formula 

t+. 

S? = S 1° 


s , . / 
5 It has been noted that (17a) gives a good approximation to (17b) when @ > tan an 
n —_— 
provided we are interested in the important practical region P < .10, at least for n < 25. 


Se 
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The statistic 7, (or T;) is easier to compute than S%;,/S’ (or S{/S’). The tabula- 
tion of the multiple integral (17) was carried out on the Bell Relay Computors 
at the Ballistic Research Laboratories. 

9. The distribution of Si_1,,/S? and Sj2/S®. As indicated in the Summary, 
the proposed criterion for judging the significance of the two largest observa- 
tions is 





n—2 
>» (x: ae ae 1 n—2 
v2 y2 p= = 
a 2 a sa D2, 
-\2 >= 2 i=] 
Zz (ze; — Z) 
+=1 


and that for testing the two smallest observations is 


n 


. ie (ai — 1,2)" 1 . 
Si,2/S' = ——___—__ < k where f1,2 = —— 5. 
> (a: — @)° a 
t=] 


I'rom the preceding section, we note that 


n n—2 
} ni = r’, z. ni = 7 sin’ 6, Sin” O,-1. 
i=2 i=2 
Hence, 
n—-2 ' 
» (x; a fie 
(18) sin’@, sin@,1 = = 
> (x: — 2)” 
i=l 


so that if we find the distribution of 
sin’ @, sin” 0,_, = sin’ A,, say, 
then we have the distribution of S%_;,,/S° and hence also that of S},2/S", i.e. 
(19) P{sin’ A, < k} = P{A, < sin” Vk}. 
Returning to the multiple integral (13), let 
sin A, = sin 6, sin On-1, 
A; = 4;, 3<icsn-l1. 
The Jacobian of this transformation is given by 
O(8n,*** 595) _ cos A, 
O(4n, ***, 4s) sin? An. — sin? A,” 
The limits of integration for A, are given by 
Vn sin An 
V2(n — 1) — (n — 2) sin? Ay-1 


0<A, < sin’ 
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and, of course, those for An; , --- , As are the same as the limits for @,-1 , --- , 93 
respectively. Hence, substituting in (13), we obtain 


r/3 ptan—! +/4/28ech; tan—14/n—1/ n—3sechn_ > 
K, I [ _—_ | 
0 0 


0 





eM asindn_1 
(20) ie " 1)—(n—2)8in24,_1 
. —3 —4 
sin” ° A, sin” An-1 --- sin’ A, sin A, cos A, dA, --- dA; - 
° n—3 ; wo ae 
sin” ~ An V/sin? A,_1 — sin? A, 
Reversing the order of integration, we have 
” af _2(n=3) — tan~14/(n—2) (n—4) 
sin V Gapany tan) (m8) 
™ Sari Vf 23 
0 sin-2_* a/2(n—1)s8indn sec! nay enAn-1 
(21) Vat oseaies 
13 ; ; 
[ ? sin” *A, sin” * A,_, --- sin A, cos A, dAz--- dAn _ 1 
sec 1. /2/4tand, V/214 tand, sin” * An-1 = sin” Ay — gin” Be 


(for A; < tan” rm , then sec” Ws —— 2 tan A; is to be put equal to 


zero where 1 > 4) so that for n = 4, 


A x/ J 
(2) Pi <a) =K[ rotna, tit Be 008 Aa ds de _ 
0 ein ie: Sin As +/sin? A; — sin? Ay 
Bin 3 


where 0 < A < sin” 2 , 


and for n = 5, 


tan~14/4.: 
P(ds < A) = Ke 1 
sin rt Asin ds -2sinA, 
(23) V/5+38in2A, 


[ sin” As cos As dA; dA, dA; 
sin-1+/2/4 tan A, SIN Ay ~/sin? Ay — sin? As 


Ton 


where 0 < A < sin” /? , ete. 


We remark that an obvious extension of the above principles should lead to 
the distributions of 
Renal and Si23/S° ’ 


v2 cy2 y2 cy2 
Bitmdtiotal © and Si,2,3,4/S ’ 


etc. although the tabulation of such probability integrals may be exceedingly 
difficult. 

The problem of tabulating the probability integral (21) involves a double 
quadrature process and has been carried out on the Bell Relay Computors at 
the Ballistic Research Laboratories for n = 4 to n = 20, inclusive. Table V 
gives some useful percentage points for these sample sizes. 
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— 
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TABLE V 
S41, n Si o3 
Table of Percentage Points for e = 
n 1% 2.5% 5% 10% 
4 .0000 -0002 .0008 .0031 
5 .0035 .0090 .0183 .0376 
6 .0186 .0349 .0565 .0921 
7 .0440 .0708 . 1020 .1479 
8 .0750 .1101 . 1478 .1994 
9 . 1082 . 1492 .1909 . 2454 
10 1415 . 1865 . 2305 . 2863 
11 . 1736 .2212 . 2666 .3226 
12 . 2044 . 2536 . 2996 .3952 
13 . 2333 . 2836 .3295 . 3843 
14 . 2605 .3112 .3568 .4106 
15 .2859 .3367 .3818 .4345 
16 .3098 .3603 .4048 .4562 
17 .oo2l .3822 .4259 4761 
18 .3930 .4025 .4455 .4944 
19 .3429 .4214 .4636 .5113 
20 .3909 .4391 .4804 .5269 
S’ = >> (4; — 2)? where # = — > > Xi 
i=] NT j=l 
n—2 1 n—2 
Gua, = Zz (2x; — 2-1 a where Za-1, as a oo Y» vi 
t=] —— t=1 
Sta =D es - aa) where he= Dm 


10. Comment on the distribution of Sj,,/S®. In connection with the distribu- 
tion of the statistic 





n—1 
2 a (xi — H12)° 1 = 
SS et ee, WD fe = ——. 2. Be, 
S? = 9 — 2 t=—2 

a (x; — 2)" 


for testing simultaneously whether the smallest and largest observations are 
outlying, an investigation indicates that since 








p & x; = ni” + “ = i (ta — #)° + 5 (a — En) + -— 5 (tes — %, J 


htt 3 _ tm toatauy _ 2 + Xa 
. dee ntats a tay 
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then the transformation 
V/2-1v2 = — 22+ 2s, 
V3-2vs 
V 4-304 


— 2 — 23 + 2%, 


— te — ey — % + 3%, 


(24) 
V(n — 2)(n — 3)vn-2 = — %2 — Xe — -++ — One + (n — 3)an41, 
V(n — 1)(n — 2)vna = — (mn — 2)ay + tet ast +++ + aa, 
V n(n = 1)vn = — % — %— 3 — °° — Gna t+ (n — 1)z., 


V 10 n+1 = + Yet °°: + Tn, 


followed by transformations of the type (11) and that of Section 9 may lead 
to the distribution of Sj,,/S°’. However, the limits of integration do not turn 
out to be functions of single variables and the task of computing the resulting 
multiple integral may be rather difficult. 


11. Examples on testing outlying observations for rejection. We now turn 
to the problem of applying our theory to particular practical examples of data 
which appear to have outlying observations. Apparently, in the following ex- 
amples there were not sufficient practical or experimental grounds to reject 
the suspected outliers and hence some statistical judgement became necessary 
either to support retaining the “outliers” in the sample or leave little doubt 
that certain of the observations should be questioned. 

EXAMPLE 1. Our first example has almost become a classical one as Irwin 
[3], Rider [2], and other writers on the subject including Chauvenet, Peirce, 
Gould, etc. (see Rider’s survey [2]) all refer to it, applying their various tests. 
The example consists of a sample of 15 observations of the vertical semi-di- 
ameters of Venus made by Lieut. Herndon in 1846 and is given in William 
Chauvenet’s, A Manual of Spherical and Practical Astronomy, II (5th ed., 
1876), p. 562. The individual residuals or deviations from the mean are: 


—0.30” 0.48 0.63 —0.22 0.18 
—0.44 —0.24 —0.13 —0.05 0.39 
1.01 0.06 —1.40 0.20 0.10 


Arranging the observations in increasing order of magnitude, we have: 


—1.40” —0.24 —0.05 0.18 0.48 
—0.44 —0.22 0.06 0.20 0.63 
—0.30 —0.13 0.10 0.39 1.01 


ores eer) 
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and it is seen that two of the residuals, —1.40 and 1.01, appear to be outliers. 
Rider [2] indicates that the above observations have been referred to by previ- 
ous writers as ‘‘residuals’’; nevertheless their sum is 0.27, so that the sample 
mean, ¢ = .018. Let us apply the exact test, ie. JT; of Pearson and Chandra 
Sekar or Sj/S’ as developed in Section 8 for a single outlier to the least obser- 
vation, —1.40. We find x, = —1.40, @ = .018 and s = .532 (alternatively, we 
find S’ = 4.2496 using all 15 observations and Sj = 2.0953 which is based on 
14 observations, the suspected outlier —1.40 not being included). Further, 
7, = 2% = O18 FM _ 2.665 (or Si/S* = 0.4981) and from Table IA 
(or Table I) we see that 0.01 < P < 0.025 so that we would reject the observa- 
tion —1.40 when using the 5% level of significance. Having rejected — 1.40, 
we now have left a sample of 14 observations and test the greatest one, i.e. 1.01. 
For 7, based on the remaining 14 observations, we have n = 14, x, = 1.01, 
& = .119 and s = .387 (alternatively, for the new sums of squares, we find 
S?, = 1.2409 leaving out 1.01 and S’ = 2.0953 including the observation 1.01). 
Hence, T, = ™—* = 19 — 119 _ 9.302 (or S%/* = 0.5922) and from 
Table IA (or I), we find P slightly less than .10, so that we decide to retain the 
observation 1.01. 

It would have been interesting nevertheless to see whether or not the test 
Si,,/S’ would have rejected simultaneously the observations —1.40 and 1.01 
if percentage points for the distribution of this statistic were available. 

It is of interest to remark that for this particular example Irwin [3, page 
245], using the difference between the first two individuals divided by an esti- 


mate of ag, i.e. ene , concluded also that —1.40 but not 1.01 should be re- 





jected. In testing both of these observations, Irwin used the single biased esti- 
mate for o, 


2S (os - 2) = > (x; — 2)” = = 5326 (assuming % = 0), 
based on all 15 observations. It is a mere coincidence, of course, that for this 
example Irwin’s test gives the same result as the exact test 7, or the test based 
on the ratio S}/S’. In this connection, Irwin rightly calls attention to the fact 
that in dealing with a sample of only 15 observations the standard deviation of 
the sample is a very unreliable estimate of the population standard deviation. 


— 2, 





It is remarked that here we would, of course, hesitate to apply the test ° 


to the observation —1.40 as we do not have available and accurate estimate of 
o from past deta. 

EXAMPLE 2. The following ranges (horizontal distances from gun muzzle to 
point of impact) were obtained in firing projectiles from a weapon at a constant 
angle of elevation and at the same weight of charge of propellant powder: 
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Distances in yards 


4782 4420 
4838 4803 
4765 4730 
4549 4833 


It is desired to know whether the projectiles exhibit uniformity in ballistic 


behavior or if some of the ranges, such as 4549 and 4420, are not consistent 
with the others. 


Arranging the distances or ranges in increasing order of magnitude, 


4420 4782 
4549 4803 
4730 4833 
4765 4838 


we suspect the presence of two outliers, i.e. 4420 and 4549. Having no available 
knowledge of o from past data for this example, an intuitively efficient test to 
apply would be that of Section 9, i.e. S}.2/S". 


We find 


s 
Ss, Z (a; — #12)" 
et = ——___—_— = 054 
, x (x; — 2) 


which is significant at the .01 level (Table V) and consequently we would judge 
the distances 4420 and 4549 yds. as being unusually low. 

As a matter of interest and as a recommended temporary practical expedient 
for testing several “‘outliers’”, consider for example the last seven of the above 
ordered observations, 


4549 4803 
4730 4833 
4765 4838 
4782 


ws 


and apply the exact test, S}/S’, to the smallest observation, 4549. We find 
Si/S’ = .145 so that 01 < P < .025 from Table I and we should thus reject 
4549 from the sample of seven. Moreover, we should now surely reject 4420 
as being outlying, arriving at the same result we had for the test Sj2/S°. Thus, 
as a general temporary expedient in testing for ‘‘outliers’’ one could rank the 
observations, and apply the tests Si/S* (or S3,/S’) and Si2/S (or Sin 'S*), 
thus working from the ‘inside’? observations of the ranked sample in order to 
establish consistency of the observations. 
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12. Additional comments. Although we have used a significance level of .05 
in the examples, it may be preferable from a practical viewpoint to reject outly- 
ing observations only at a lower level, such as .01 or .005. 

Extensions of the ideas for testing outlying observations presented in this 
paper may lead to efficient sample criteria for testing the significance of various 
numbers of high, low, or simultaneously high and low sample values. However, 
the mathematical details would probably be complicated. In this connection, 
it is remarked nevertheless that the advent of high-speed computing devices 
may have considerable bearing on establishing experimentally any probability 
distribution. That is to say high-speed electronic computing devices could prob- 
ably be programmed to generate random numbers with frequencies equal to those 
of the normal (or any other) distribution, to compute various functions (such as 
ratios in this paper) of sample values, etc., and establish frequency distributions 
to a desired order of accuracy. 
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Summary. In this paper the observations are considered to be normally dis- 


tributed with constant variance and means consisting of linear combinations 
of certain trigonometric functions. The likelihood ratio criterion for testing the 
independence of the observations against the alternatives of circular serial cor- 
relation of a given lag is found to be a function of the circular serial correlation 
coefficient for residuals from the fitted Fourier series (Section 4). The exact dis- 
tribution (Section 5), the moments (Section 6), and approximate distributions 


1 Included in Cowles Commission Papers, New Series, No. 42. 
2 Presented to the meeting of the Institute of Mathematical Statistics at New York, 


December 30, 1947. 


3 Fellow of the John Simon Guggenheim Memorial Foundation; Research Consultant 
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(Section 7) are given for the cases of greatest interest. From these results sig- 
nificance levels have been found (Section 3). The use of these levels is indicated 
(Section 2), and an example of their use is given (Section 3). 


1. Introduction. ‘wo mathematical models have been used extensively in 
time-series analysis. In one model the observation is the sum of a “systematic 
part” and a random error. The cyclical properties of this model result from the 
cyclical properties of the systematic part, which is usually taken to be a short 
Fourier series. The stochastic element is superimposed on the non-stocbastic 
part, and the error at one time point does not affect a later observation. The other 
model is the stochastic difference equation or ‘‘autoregressive model.”” An ob- 
servation is the sum of a linear function of previous observations and a random 
element. The cyclical properties follow from the properties of the difference 
equation (i.e., the linear combination of observations), but are disturbed by the 
random disturbance that is integrated into the system. A more general model 
can be constructed that includes both of the two mentioned. The observation 
can be taken as a linear combination of past observations and Fourier terms plus 
a random element. 

In this paper, the linear combination will be only a multiple of some preceding 
observation. For lag 1, the model is of the form 


(1) Le ws = (Tin — win) + 4u:, v= 1,2 “* oR, 


where x» = x, and wo = un. In (1), the {z;} are the N observations; the {u,} 
are N random disturbances, each assumed normally and independently dis- 
tributed with zero mean and variance o’; the means {y;} are linear combinations 
of some of the N functions of 7: cos =a and sin _. For N odd, g = 0,1, ---, 
4(N — 1);h = 1, ---, 3(N — 1). For N even, g = 0,1,---,3N;h = 1,---, 
$N — 1. Hence, 
- " 
(2) i = >, ar COS a + >> By sin ta ; 
eo N he N 

where g’ and h’ run over certain values of the ranges of g and h, respectively. 
Let K’ be the number of terms in (2). Usually the constant term, ap , is included 
(in this case g = 0 and cos = = 1). Of the N trigonometric functions available, 
the terms in (2) are usually chosen so that terms with certain periods are in- 
cluded and terms with other periods are excluded. It should be noted that (1) 
defines a circular model. 

The sample estimates of a,, and @,- are the usual regressions of z; on 

© af "27 

cos oe and sin nd respectively. Because of the orthogonality of these trig- 


onometric terms, the estimates are 
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N -y 
ay = 2 2, cos 8 /}. g ~ 0,3N, 


N 
~ . 2rth’ /N 
bh. = i ——— oman 
h 2, a sin 7 / = 


“6 wm = dx /N, 


t=1 


N N 
ay = >, x cosmi /N = Do (- n/N. 
t=1 


t=1 


The fitted series is 


(4) m; = >. dg cos a + >> by sin a ‘ 
a’ N h’ N 





where the sums on g’ and h’ are over the ranges in (2). 
The serial correlation coefficient suitable for this model is 


a (x; — m,) (a4 — mj) 


Zz (x; = mi)" 


t=1 


(5) R 


? 


where mm = m,. This statistic can be used to estimate p, or it can be used to 
test hypotheses about p. In fact, for the circular model this statistic leads to the 
best tests [3]. 

It is hoped that the mathematical model studied in this paper can be used in 
the treatment of certain problems in economic time series. For example, the 
seasonal variation in a series of data may be considered as a “‘systematic part”’ 
made up of trigonometric components. In the next section we discuss in a more 
detailed way how the use of this model may arise in the field of economics. 

We have considered circular serial correlation, although in most statistical 
problems it is non-circular serial correlation that is involved. The reason for 
treating the circular case is the inherent mathematical simplicity. The circular 
coefficient and Fourier series of the type (2) are ‘‘naturally” related. The relevant 
fact is that the vectors 


cos ~~ cos . cos art) and { sin = sin . ... sin va) 
N’ Pi F N N ’ N ’ , N 


are characteristic vectors of the matrix of the quadratic form in (x; — m,) of 
the numerator of R. For this reason the distribution and significance points 
are easily obtained. 

In the usual applications the circular coefficient can be used even if the hypoth- 
esis alternative to independence of observations is non-circular serial correla- 








62 R. L. ANDERSON AND T. W. ANDERSON 


tion. The circular coefficient may not have as good power against non-circular 
alternatives as non-circular coefficients, such as 


> (2; — mi) (4:4 — mi-1) 
(6) re inns _ 





etn 
2 (x; — mi)” 
t=] 
However, the difference between these two statistics is (x; — m) (tx — my)/ 
2(x; — m,)*, and it can be shown that this converges stochastically to zero (as 
N increases and p remains fixed). 


2. The use of fitted Fourier series. A linear combination of trigonometric 
terms may be used as a regression function when there is a “systematic part” 
(or ‘“‘trend”’) that is periodic. For instance, it may be reasonable to assume that 
a series of agricultural data has a systematic component with certain periodicities 
due to variation in weather. Then one may ask whether this regression function 
“explains” all of the interrelations in the series. 

An example taken from agricultural economics is a development of that given 
by Koopmans [8]. Suppose p; and q; are the price and supply, respectively, of a 
given farm product at time ¢. Let Q{” be the quantity demanded at time ¢ if 
p: = P, and Q‘” be the quantity supplied at time ¢ if p,. = P, where P is an 
arbitrarily selected point of reference on the price scale, serving to define the 
Q’s. Let the market equations be defined as follows: 


(7) pe — P = —Bq — Q) + ue, 
(8) ie or = 6(pr-z —-P)+%, 
where u and v are random disturbances. The first equation expresses the price 
depressing tendency of an abnormally large supply; the second expresses the 
supply-stimulating influence of abnormally high prices Z time units earlier (the 


time between planning the product and selling it). We can substitute from (7) 
at time (t — ZL) into (8) and obtain 


(9) qe — QE = ogee — Q21) + we, 
which is of the form (1) for general lag L (¢ — 1 is replaced by t — L) if 
Qo — pQe, = ut — purr. Now ‘we may wish to test the null hypothesis, 


H,:p = 0. If we assume that our alternative hypothesis is H, : p > 0, we can 
test the null hypothesis by use of the positive tail of the distribution of R. Simi- 
larly for Ha: p < 0, we would use the negative tail of the distribution of R. In 
other cases, if we believe p # 0, we might wish to estimate p. 

It is of particular interest to consider using the Fourier series for seasonal 
variation. The most important cases are given below with indications of the 
appropriate tables of significance points for testing the hypothesis p = 0. (a) 
Annual data. Here only a constant is fitted; this is the sample mean. The tables 


ETNIES TT 


GEERT Eee rer me 
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given in [2] or [5] are to be used. (b) Semi-annual data. To “correct” for varia- 
tion of period two we fit a constant and cos rt = (—1)‘. The table given in Sec- 
tion 3 for P = 2 is to be used. (c) Quarterly data. The four terms to be fitted are 


l . . ; : . 
1, cos rt = (—1)', cos = and sin = . The table given in Section 3 for P = 2 


and 4 is to be used. (d) Bimonthly data. The six terms to be fitted are 1, cos rt, cos 
Qnrt . 2nt 


q 7 Sin -.~ » COB x , and sin * . The table given in Section 3 for P = 2, 3, and 
6 is to be used. (e) Monthly data. The twelve terms to be fitted are 1, cos *, 
sin .. cos =, sin bo COs - sin - cos oat sin ~_ cos _ sin = and cos mt = 
~ 6 _- s 2’ 2 3’ 3” 6° 6’ 

(—1)‘. The table given in Section 3 for P = 2, 12/5, 3, 4, 6, and 12 is to be used. 
It is assumed here that the data are given for each time interval in a certain 
number of years. Then the residuals are the same as the residuals taken from 
means for each month or season. That is, if the data are monthly, one may com- 
pute the sample means for January, February, etc., and residuals are to be taken 
from the corresponding monthly means. The fitted Fourier coefficients are cer- 
tain linear functions of these means. 


3. Tables of significance points of R. 


3.1. Significance points of R using a seasonal trend for annual, semi-annual, bi- 
monthly, and monthly data. The calculations of significance points of R (lag 1 
only) have been subdivided according to the number of terms included in the 
estimating equations, m; . The significance points for only a constant in m; have 
been tabulated in [2] and [5]. Since the main use for m; equations involving sine 
and cosine terms seems to be for semi-annual, quarterly, bimonthly, and monthly 
data, for which N is even, the results presented in this paper are for N 
even. Then we will have all of the sine and cosine terms in pairs except for cos 
mi = (—1)‘ and the constant term. We shall find it convenient to refer to the 
period P,- = N/g’ or Py, = N/h’ of the terms in (2). 

We have calculated significance points R’ exact to 3 decimal places, 
for Pr{R > R’} = a = 01, .05, .95, and .99. The values of R’ correspond- 
ing to a = .01 and .05 are usually indicated as the positive significance points 
and those corresponding to a = .95 and .99, the negative significance points. In 
all of these cases, except for annual data, the distribution of R is symmetrical. 
Hence only the positive significance points need be given, since the negative 
points are simply the corresponding positive points with opposite sign; that is, 
R’ (.95) = —R’ (.05), R’ (.99) = —R’ (.01). 

The significance points were calculated from the exact distribution of R 
given in Section 5 for all N up to the values where the approximate significance 
points using an Incomplete Beta distribution (Section 7) were the same as the 
exact significance points. The Incomplete Beta significance points were used 
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up to the value of N for which a normal approximation was satisfactory. For 
some of the results, the normal points became sufficiently accurate to be used 
following the exact points. 

The values of #’ are given in Table 1 except for (a), for the following values 
of N: 

(a) Annual data—see the tables in [2] or [5]. 

(b) Semi-annual data (P = 2): N = 6(2)60. The exact points were needed 
for N through 10(a@ = .05) and N through 22 (a2 = .01). The normal points 
could be used for N = 60 (a = .05) but were still too large by .003 for N = 60 
(a = Ol) 

(c) Quarterly data (P = 2, 4): N = 8(4)100. The exact points were needed 
for N through 20 (@ = .05) and N through 32 (a = .01). The normal points 
were adequate for all N above 20 (a = .05) but were still too large by .001 for 
N = 100 (a = 01). 

(d) Bimonthly data (P = 2,3, 6): N = 12(6)150. The exact points were needed 
for N through 24 (a = .05) and N through 30 (a = .01). Again the normal 
points were adequate for all N above 24 (@ = .05) but were still too large by .0005 
for N = 150 (a = Ol). 

(e) Monthly data (P = 2, 12/5, 3, 4, 6, 12): N = 24(12)300. The exact points 
were needed for N = 24 (a = .05) and N = 24, 36 (a = .01). The normal points 
were adequate for N > 24 (a = .05) and N > 300 (a = .01)." 

Significance points for the Incomplete Beta approximation (See Section 7) are 
tabulated in terms of 2p and 2q. The values of 2p and 2q are the same when 
ui(R) = 0; for (c), (d), and (e) above these values are simply N — 3, N — 
and N — 11, respectively. Hence, for two-tailed significance points for these 
cases, the ordinary correlation tables can be used with N — 3, N — 5, and N — 11 
degrees of freedom, respectively. Also, our one-tailed significance points can be 
approximated by use of the 10% and 2% significance points for the ordinary 
correlation coefficient. 10%, 5%, 2%, 1%, and 0.1% two-tailed significance 
points have been tabulated by Fisher and Yates [6]. These significance points 
are accurate to three decimal places for the serial correlation coefficients as 
follows: 

(c) n = N — 3 degrees of freedom: N > 24 (a = .05); N > 36 (a = .01), 

(d) n = N — 5 degrees of freedom: N > 24 (a = .05); N > 30 (a = 01), 

(e) n = N — 11 degrees of freedom: N > 24 (a = .05 anda = .01), where 


a is the one-tailed significance point. For semi-annual data (b), 2p = 2q = 

N’® — 3N = 4 “a ; ’ 
As which is not an integer for N > 12. When N = 12, 2p = 
l — 

2q = for which the ordinary correlation significance point is adequate 


for a = .05. 


‘It aia be noted that for (c), (d), and (e), an approximation given by Cochran [4] 
is easily computed and is more accurate than the normal approximation for thea = .0l 
significance points. 

5 In [6] n is 2 less than the number of pairs used in computing the ordinary correlation 
coefficient when the sample means are first subtracted. 
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Details of computing techniques using the exact distribution are given by 
R. L. Anderson [1] for computing values of R’ when yu; = 0. 

3.2. Significance points of R for other single-period trends. Significance points have 
also been obtained for P = 3, P = 4, P = 6, and P = 12, for which K’ = 3. 


TABLE 1 
Exact significance points, R', for different fitted series* 





P=2 Pp =2,4 | P = 2,3,6 P = 2, 12/5, 3, 4, 6,12 





‘ = " > aiacae ' = 
N\q@ 05 | OL |N\@| 05 01 | N\a| 05 | 01 |N\a@| 05 | 01 





6 .495 | .499 | 8) .6386 | .693 | 12) .592 | .744 | 24) .441| .592 

8 | .484 | .607 | 12) .515 | .661 | 18 | .442| .592 | 36 | .323| .445 
10 | .453 | .601 | 16 | .439 | .582 | 24} .369 | .504 |} 48 .267| .371 
12.426 | .572 | 20 | .388 | .523 | 30) .323 | .445 | 60 | .233] .325 
14 | .402 | .544 | 24/ .351 | .478 | 36 | .291 | .403 | 72 .209] .293 
16 | .382 | .519 | 28 | .323 | 441 42 | .267 | .371 | 84 | .191| .268 
18 | .364 | .496 | 32 | .300 | .414 |) 48 | .248 | .346 | 96 | .177| .249 
20 | .348 | .476 | 36 | .282 | .391 | 54 | .233 | .325 | 108 | .166) .234 
22 | .334 | .458 | 40 .267 | .371 | 60 | .220 | .308 | 120 | .157| .221 
24 | .821 | .442 |) 44 | .254 | .354| 66 | .209 | .293 | 132 | .149| .210 
26 | .310 | .427 | 48 | .243 | .338 | 72 | .200 | .280 | 144 | .142| .200 
28 | .300| .414 | 52 .233 | .825 | 78 | .191 | .268 | 156 | .136) .192 
30 | .290 | .402) 56 .224 | .313 | 84] .184/ .258 | 168 | .131| .184 
32 | .282 | .390| 60 .216 | .302 | 90 | .177 | .249 | 180 | .126) .178 
34 | .274 | 380) 64 | .209 | .293 | 96 | .172 | .241 | 192 | .122) .172 
36 | .266 | .370 | 68 | .202 | .284 | 102 | .166 | .234 | 204 | .118] .166 
38.260 | .361 | 72 | .197 | .276 | 108 | .161 | .227 | 216 | .115} .162 
40 | .254| .353 | 76) .191 | .268! 114 | .157 | .221 | 228 | .111) .157 
42 | .248 | .345 | 80 | .186 | .261 | 120 | .153 | .215 | 240 | 108) .153 
44 .242 | .338, 84 .182 | .255 | 126 | .149 | .210 | 252 | .105| .149 
46 | .237 | .331 | 88 | .177  .249 | 132 | .145 | .205 | 264 | 103) .146 

| 


Ww 
bo 
qu 














48 | .233 | 324 | 92 | .173 | .243 | 138 | .142 | .200 | 276 | .101) .142 
50 | .228 | .318 | 96) .170 | .238 | 144 | .139 | .196 | 288 | .099| .140 
52 | .224 | .313 | 100 | .166 | .234 | 150 | .136 | .192 | 300 | . 

54 | .220 | .307 | | 

56 | .216 | .302 
58 | .212 | .297 | | | | | 
60 | .209 | .292 | | | | | 


| | | 








* P = Periods Used in Fitted Series. 


In these cases, the distribution of R is asymmetrical. The Incomplete Beta 
approximation is symmetrical for P = 3, with 2p = 2q = N — 2, even though 
the exact distribution is not. 

The significance points for these single-period trends are given in Table 2. 
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The exact distribution was required to compute the a = .01 and .99 significance 
points for N through 48 in all cases and also for most cases with a = .05 and 
.95. For N > 48, the Cochran approximation [4] gave the same results as the 
Incomplete Beta approximation. Since this Cochran approximation can be com- 
puted more rapidly, it should be used if other significance points are desired. 
The normal approximation is not recommended because it is less accurate than 
the Cochran approximation and requires almost as much calculation. For a = .01 
and .99, the significance points using the normal approximation were too large 
(in absolute value) by from .0005 to .001 for the last entries in Table 2. The two- 


TABLE 2 
Exact significance points, R’, for single periods > 2 

















P=3 | P =6 
| a | a 
N — | N $$$ $$ 
.99 95 | 05 | Ol | .99 95 05 O1 
6 | —.970 | —.854 | .496 | .500 | 


12 | —.690 | —.522 | .475 | .619 | 12 | —.766 .651 | .296 | .506 
18 | —.558 | —.409 | .392 | .526 | 18 | —.630 | —.509 | .277 | .440 
24 | —.480 | —.348 | .340 | .463 | 24 | —.540 | —.427 | .254 | .393 
30 | —.428 | —.309 | .304 | .417| 30| —-. .236 | .359 
36 | —.389 | —.280 | .277 | .382 | 36] —.438 | —.335 | .220 | .332 
42 | —.360 | —.257 | .256 | .356 | 42 | —.403 | —.306 | .207 | .311 
48 | —.336 | —.240 | .240 | .384 | 48] —.375 | —.283 | .197 | .294 
54 | —.316 | —.226 | .226 | .316| 54 | —.352 | —.264 | .188 | .279 


| 
cS 
QO 
bo 

| 
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60 | —.300 | —.214 | .214 | .300 | 60 | —.333 | —.248 | .180 | .266 
66 | —.286 | —.204 | .204 | .286 | 66 | —.316 | —.285 | .173 | .255 
72 | —.274 | —.195 | .195 | .274.| 72 | —.301 | —.224 | .167 | .246 
78 | —.263 | —.187 | .187 | .263 | 78 | —.288 | —.214 | .161 | .237 
84 | —.254 | —.181 | .181 | .254 | 84 | —.277 | —.205 | .156 | .229 
90 | —.245 | —.175 | .175 | .245 | 90 | —.267 | —.197 | .151 | .222 
96 | —.237 | —.169 | .169  .237 | 96 | —.258 | —.190 | .147 | .216 
102 | —.230 | —.164 | .164 | .230 | 102 | —.250 | —.184 | .143 | .210 
108 | —.224 | —.159 | .159 | .224 | 108 | —.242 | —.178 | .140 | .205 
114 | —.218 | —.155 | .155 |".218 | 114 | —.235 | —.173 | .187 | .200 
120 | —.212 | —.151 | .151 | .212 | 120 | —.229 | —.168 | .184 | .195 
126 | —.207 | —.147 | .147 | .207 | 126 | —.223 | —.163 | .181 | .191 
132 | —.202 —.144 | .144 | .202 | 132 | —.218 | —.159 | .128 | .187 
138 | —.198 | —.141 | 141.198 | 188 | —.218 | —.155 | .125 | .183 
144 | —.194 | —.138 | 188.194 | 144 | —.208 | —.152 | .123 | .180 





150 | —.190 | —.1385  .185 , .190 , 150 | —.203 | —.148 | .121 | .177 
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TABLE 2—Continued 





} 99 | 295 o | o | | 299 9 | 0 | 01 





g | —.889 | —.768 | .503 | .687 | 12 | —.778 | —.671 | .096 | .245 


2 | —.742 | —.608 | .420 | .585 | 24 | —.555 | —.444 | .197 | .330 
16 | —.643 | —.502 | .369 | .522 | 36 | —.447 | —.348 | .188 | .298 
20 | —.576 | —.441 | .833 | .474 | 48 | —.383 | —.293 | .175 | .270 
24 | —.519 | —.396 | .306 | .487 | 60 | —.339 | —.257 | .163 | .249 
28 | —.477 | —.361 | .285 | .407 | 72 | —.307 | —.231 | .153 | .231 


32 | —.445 | —.334 | .268 | .383 | 84 | —.283 | —.212 | .145 | .217 
36 | —.418 | —.312 | .253 | .363 | 96 | —.263 | —.196 | .138 | .206 


40 | —.395 | —.298 | .241 | .345 | 108 | —.247 | —.183 | .132 | .196 
44 | —.375 | —.277 | .230 | .330 | 120 | —.233 | —.173 | .126 | .187 
48 | —.358 | —.264 | .221 | .317 | 132 | —.221 | —.164 | .121 | .180 
52 | —.343 | —.252 | .213 | .305 | 144 | —.211 | —.156 | .117 | .173 





56 | —.330 | —.242 | .206 | .294 | 156 | —.202 | —.149 | .113 | .167 
60 | —.319 | —.233 | .199 | .285 | 168 | —.194 | —.143 | .110 | .162 
64 | —.308 | —.225 | .193 180 | —.187 | —.138 | .107 | .157 
68 | —.298 | —.218 | .188 | .269 | 192 | —.181 | —.133 | .104 | .153 
72 | —.289 | —.211 | .183 | .262 | 204 | —.175 | —.128 | .101 | .149 
76 | —.281 | —.205 | .178 | .255 | 216 | —.170 | —.124 | .099 | . 
80 | —.274 | —.199 | .174 | .249 | 228 | —.165 | —.121 | .097 | .141 
84 | —.267 | —.194 | .170 | .243 | 240 | —.161 | —.117 | .094 | .138 
88 | —.261 | —.189 | .166 | .238 | 252 | —.157 | .092 
92 | —.255 | —.184 | .162 | .233 | 264 | —.153 | —.111 | .091 | .132 
96 .249 | —.180 | .159 | .228 | 276 | —.149 | —.109 | .089 | .130 
100 | —.244 | —.176 | .156 | .223 | 288 | —.146 | —.106 | .087 | - 
108 | —.234 | —.169 | .150 | .215 | 300 | —.143 | —.104 | .086 | .125 
120 | —.221 | —.160 | .143 | .205 | | 

132 | —.210 | —.152 | .136 | .196 
144 | —.201 | —.145 | .131 | .187 
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tailed significance points cannot be obtained from the ordinary correlation 
tables except for P = 3. 

3.3. Example of use of significance points. As an example of the use of these 
significance points, R’, we shall consider the following data [17] on the receipts 
of butter (in units of 1,000,000 pounds) at five markets (Boston, Chicago, San 
Francisco, Milwaukee, and St. Louis). The figures in parentheses are deviations 
from the average of the given months over the 3 years. 














68 R. L. ANDERSON AND T. W. ANDERSON 
¥ 
Month | —— one i —- — Average 
| 1935 | 1936 1937 | 

pacers Ratatat eal 5 acs il ica — is becca 
Jan. | 48.9(2.4) | 48.3(1.8) | 42.4(—4.1)} 139.6 | 46.5 
Feb. | 43.4(—0.6)| 47.1(8.1) | 41.4(—2.6)| 131.9 | 44.0 
March | 43.8(—4.6)} 52.4(4.0) | 49.0(0.6) | 145.2 | 48.4 
April | 50.8(—1.5)| 55.3(3.0) | 50.8(—1.5)| 156.9 | 52.3 
May | 67.6(1.6) | 64.7(—1.3)} 65.8(—0.2)) 198.1 | 66.0 
June | 83.7 (0.7) | 79.5(—3.5)| 85.9(2.9) | 249.1 | 83.0 
July | 82.7(10.7) | 62.6(—9.4)) 70.6(—1.4)) 215.9 | 72.0 
Aug. | 60.8(4.8) | 51.3(—4.7)| 55.8(—0.2)| 167.9 | 56.0 
Sept. | 55.4(3.6) | 51.0(—0.8)| 49.1(—2.7)| 155.5 | 51.8 
Oct. | 48.4(—1.0)| 54.0(4.6) | 45.7(—3.7)| 148.1 | 49.4 
Nov. | 87.7(—4.5)| 45.2(3.0) | 43.8(1.6) | 126.7] 42.2 
Dec. | 41.0(—3.2)| 44.9(0.7) | 46.7(2.5) | 132.6 | 44.2 

Total 664.2(8.4) |656.3(0.5) 1647 .0(—8.8)| 1967.5 | 655.8 

Average 55.35 (0.70) | 54.69(0.04)| 53.92 | 163.96 | 54.65 


(—0.73) | 


We assume that the trend is composed of the 12 terms having periods that 
divide 12. We shall test the null hypothesis that the deviations from the trend 
are independently distributed against the alternative that there is positive 
serial correlation. The fitted series is of the form 


5 as -. 
(10) m; = bo + Zz (vis COs i + b3; sin *) + bi cos m7; 
j=1 ) 
here we find it convenient to use the notation, bo , bi, --- , bi, for the coef- 


ficients (with a different relationship between the, subscripts and the trigono- 
metric functions than in (4)). We find that the m; are simply the average receipts 
given for each month in the above table (46.5, 44.0, --- , 44.2). Hence the devia- 
tions (7%; — m;) are given by the figures in parentheses (2.4, —0.6, --- , 2.5). The 
calculated lag 1 circular serial correlation coefficient is 


p, = (24)(=0.6) + (—0.6)(—4.6) + --+ + (1.6)(2.5) + (2.5)(2.4) 
. (2.4)? + (—0.6)? +--+ + (2.5) 





(11) 
232.18 
= ——— = 0.489. 
474.51 
Entering Table 1 for P = 2, 12/5, 3, 4, 6, and 12 and N = 36, we find that 
R’ (.05) = 0.323 and R’ (.01) = .445. Hence, at either the 5% or 1% level the 
null hypothesis of zero serial correlation (9 = 0) is to be rejected (against the 
alternative single-tail hypothesis, p > 0). If we had been interested in the two- 


ITER ore eS PER man oe 
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tailed alternative hypothesis, p # 0, we would use the ordinary correlation tables 
with N — 11 = 25 degrees of freedom and we would find that for the two-tailed 
test R’ (.01) = 0.487. Our value is significant at the 5% level and barely signifi- 
cant at the 1% level. 


The values of b* in (10) are computed as follows 


12 
bs = >. T;/36, 


i=! 
= 1) 
b3;-1 = >, T; cos Y /i8, 
i=] 
(12) 12 ee 
bf, = >> T; sin - / 18, 
i=] 


12 
bi = >, T; cos 7i/36. 
i=] 


The computed values of bp to bj; are 54.65, —14.82, —2.02, 6.60, 1.23, —3.98, 
0.30, 2.21, 1.73, —0.61, 0.60, 0.15, respectively. However, it is not necessary to 
compute these values in order to obtain m;. The problem of estimating the 
variances of these b’s will be discussed in Section 4. 


4. Testing the hypothesis of lack of serial correlation. 


4.1. Statement of the problem. Consider the N random variables u;, --- , uy, 
each normally and independently distributed with mean 0 and variance oa’. 
Define the N variables x; , --- , ty by the equations 
(13) %i- w= p(@i-1 = Mi-t) + u; (a _ l, ane ,N), 
where 
(14) tj = Un-j, b-j = My-j G = 0,1,---,N — 1) 


and yp; is the linear combination of trigonometric functions given in (2). If L 
and N are relatively prime (in particular, if LZ = 1), the Jacobian of the trans- 
formation from {u;} to {x;} is 1 — p*, and the probability density of {z;} is 


lL — p* -to/e2 
15 eli 
(15) (Qmo2)iw € 


N N 

where Q = (1 + p’) >> (x; — us)” — 20 d (ci; — w)(ti-c — wiz). If L = 1, 
i=l i= at ; 

the covariance between x; and 2; is o[p'?! + p*""/{(1 — p*)(1 — 1°). If 


L = qa and N = pa, where p=, g, and @ are positive integers and q and p are 
relatively prime, then the Jacobian is (1 — p”)* and the density of {z;} is 


2 (1 es p’)* —}Q/a2 
16 ———___— @ . 
(16) (Qraxyiw ° 
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We shall now obtain the likelihood ratio test of the hypothesis Ho : p = 0 on 
the basis of a sample consisting of one observation on each 2; . 

4.2. Preliminary transformations. We shall find it convenient to express y; in 
terms of fixed variates ¢;; , having certain properties. Later we will verify that 
the ¢’s are simply constant multiples of the trigonometric terms in (2). We sup- 
pose now that 


‘i 
(17) oi > i573 @@=1,--- NV), 
where K’ < N, the jy;! are parameters, and the ¢;; are known functions of 7 and 
j satisfying 


(18) Qi—1,3 + Oi41,5 = 2d 1; ij (2 = l, ieee ai J = i, Pe , Kk’), 
N 
(19) 7. ois oi = O 5k Q, k= I, ae k"), 
i=] 
(20) o-i; = ov-ij (¢§ = 0,1,---,N — 1), 
and 6; is the Kronecker delta. Let 
aie 
(21) mi = Do ise; , 
j=1 
where 
N 
(22 c= a Xi bij - 
Then by usual regression theory we have 
N 
(23) > (r:1 — moi; = 0, 
t=) 
N 7 N K’ y 
(24) > (a: — wd’? = dS (es — mm)? + a (e; — v3) 
i=] =] )= 


because c; is the least squares estimate of y;. Let us evaluate 


iC = 7 (2; — wi)(ti-n — Mi-z) 


+=) 


= > [(ai — mi) + (m — wadJ[(ai-n — mit) + (Mi-t — wi-2)] 


=) 
N N K’ 
(25) = 7 (2; — m,)(@i-r — mi-1) + - z di-1,j(€; — ¥3)(%i — mi) 
i=l t=] j=l 
N x? 
+2 a bile; — ¥5)(%i-L — mMi-1) 
‘=l]1 )= 


N K 
—- 7 2. Pik $i—1,3(Cx ea vx) (¢; i 73). 


s=1 7,k=1 


SEEN 


— 
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Call the first term on the right hand side of (25) ,C. In view of (20) the next two 
terms are 
. | h N 
(26) dX De (xi — mi)(bi-n,s + bi41,;)(C; — 3). 
j=1 i= 
This is seen to be zero by consideration of (18) and (23). The last term can be 
written 


iv = K’ 
(27) 3 dX Ae, (Dik Gi—1.5 + digr,;bix)(cx — Ye)(e; — 75) = 2» Ari(e; — vi) 


by use of (18), (19), and (20). Thus 
N K’ 

(28) iC = 2 (x; — ms)(ai-1 — Mir) + Do Arie; — 7;)”. 
= j=l 

It follows that 


Q = (1 + p) a (x; = m;)° — 2p a (x; -* m;)(tint = mit) 
(29) as 
- a, (1 + p — 2prz;)(c; — v5)”. 


We can complete the matrix 6 = (¢;;) so that @ is an N-th order square matrix 
with elements satisfying (18), (19), and (20). If we make the transformation 


- 
(30) ai = 2D distj (= 1,---,), 
& 

then 
N N 
(31) a @—m)= Dd c, 
t=] j=K’'+1 
N N - 
(32) > (ai — mein — mrt) = DO Age;. 
t=1 j7=K l 


4.3. The likelihood ratio criterion. To obtain the likelihood ratio test of the 
hypothesis Hy : p = 0 against alternative hypotheses H, : p ¥ 0, we divide the 
maximum of the likelihood assuming Ho by the maximum of the likelihood as- 
suming H,. It is clear from (15) and (29) that if Ho is true, the maximum like- 
lihood estimates of y; and o’ are c; and 


N 
(33) ju EF te ~ wl, 
N i= 


respectively. If H, is true, the maximum likelihood estimate of y; isc; . Tostate 
the maximum likelihood estimates of o° and p under H, it is convenient to define 
LR, the sample serial coefficient of lag L, as 

1 


N 
(34) Lk = Ns 2. (x; = mM) (Xian — mi-1). 
INSo i=1 
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Then the maximum likelihood estimate of o under H, is 


(35) s = si(1 + 6 — 26.R), 

where f is the maximum likelihood estimate of p and satisfies 
(36) rR(1 + p*) — a(1 + 6°’) = 0, 

if L and N are relatively prime and satisfies 

(37) LR(1 + 6°) — a(l + ”*) = 0, 


if L = ga, N = pa, and p and g are relatively prime. 
Upon substituting these estimates into the likelihood function we find that 
the likelihood ratio criterion is 





(38) _ (+ = 2.8) 
1 — p*¥ ? 
if LZ and N are relatively prime and 
-2 + pa 
(39) . utes - 2p.R)" 
1 — pP ; 
if L = ga, N = pea and p and g are relatively prime. The maximum likelihood 


estimate of p is the root of (36) or (37) that makes (38) or (39), respectively, a 
minimum. It should be noticed that throughout this section p could be replaced 
by 1/p (and changing o° by a factor 1 + p'). To make the maximum likelihood 
estimate unique, we require that | 6| < 1. It can be shown that there exists one 
and only one root of (36) or (37) that satisfies this requirement and minimizes 
\. (There is a peculiarity to this solution in that if N is odd, L = 1, and ,R < 
—1 + 2/N, then 6 = —1 is the root minimizing Q). In any case, J is a function 
of LR. We have shown that for 0 < ,R < 1, it is a monotonic decreasing func- 
tion; and for —1 < ,R < 0, it is a monotonic increasing function. A critical 
region defined by \ < Xo can, therefore, be defined by .R < Ri < OandO < Rz < 
LR. (The probability that .R = —1 or +1 is 0.) Thus we can use _F to test the 
null hypothesis Hy : p = 0 instead of the likelihood ratio criterion (against one- 
sided alternatives they are equivalent). The strongest justification for the use 
of .R in testing Ho: p = 0 is that for circular distributions the uniformly most 
powerful tests against one-sided alternatives and the B, test against two-sided 
alternatives are given in terms of inequalities on ,PR [3]. 

We can also use ,F as an estimate of p. In fact, .R is asymptotically a root of 
(36) or (37). This is proved by showing that .R(1 + .R*) — .R(L + LR™*) = 
LR**(1 — ,R’) converges stochastically to zero. We shall use ,R both to esti- 
mate p and to test hypotheses about this parameter.” 

Now we shall define ¢, ; used in Section 4.2 in terms of the trigonometric terms 
indicated in Section 1. In the rest of the paper we shall let the index g run from 


6 W. J. Dixon [5] arrived at ,R as the maximum likelihood estimate for yu; a constant by 
neglecting the Jacobian in (15). 


ee 
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0 to 3N for N even and from 0 to 3(N — 1) for N odd; we let the index h run 
from 1 to }N — 1 for N even and from 1 to $(N — 1) for N odd. We shall use a 
prime to denote an index running over those values corresponding to fitted terms 


and a double prime to denote an index running over those values corresponding 
to terms not fitted. 


—_ ; ; 2rig . 2Qath, 
Let the N trigonometric functions of 7, namely cos N and sin — be num- 
4 


bered from 1 to N such that the fitted terms are numbered from 1 to K’ and the 
non-fitted terms from K’ + 1 to N. According to this numbering we define ¢,; to 
din as 


 _ f2  Qrig 
(40) oi; = (/2 cos WV” 
or 

ad 2 . 2th 
(41) dij — N sin N . 


Defined this way, the ¢;; satisfy (18) and (19) and (20). It can be shown by using 
the addition formulas for sines and cosines that 


(42) ALj = cos 2rLf 


-_ 


where f = g or f = h depending on whether ) refers to a term (40) or (41). We 
shall assume that the numbering of trigonometric functions is such that 


(43) Au.eeq 2 Arer4e => >A. 


It can easily be seen that (2) is of the forma (17) except that a,, and By: mus" 
be multiplied by 1/3N unless g’ = 0 or $N and by VN for g’ = 0, 4N to obtain 
vy; . The regression coefficients a,, and by, are similarly related to the c; . 

It can be seen from (29) that ™ a, and by; are independently distributed with 


variance 4No° /( +p° — 2pcos — -) for f ~ 0,3N and variance No’/(1 — p)” 


for f = O and for f = 43N if L is even and No’ /(1 + p)’ for f = 3N if L is odd. 
In these variance formulas we can estimate o° from (35) using ,R for # and p. 


5. The exact distribution of ,R. 


5.1. Introduction. Under the null hypothesis Ho : p = 0 the observations {x,;} 
are normally and independently distributed with variance o and means Ez; = y; . 
The variables c; defined by (22) and (29) are normally and independently dis- 
tributed with variance o° and means y;. For j > K’, y; = 0. It follows from 
(31), (82), (33), and (34) that 

N 
pw Azj C; 


(44) Le = 
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where the \z,,; are given by (42) corresponding to the K’’ = (N — K’) trigo- 
nometric terms not fitted. Thus to obtain the distribution of ,R we need only 
consider the joint distribution of {c;},7 = K’ + 1,---,N. If H, is true, the 
joint density of all the c; is (15), where 


oe 
(45) Q=(1+ p)V — 29.0 + 2 (1 + p’ — 2prx;)(c; — 5)", 


and 
N N 
V= > c and C= DO rAyej. 
j=K’+1 j=K’+1 


5.2. Some special distributions of 1R = R. If the constant term (g’ = 0) is 


fitted and the other terms are fitted in pairs (cos = and sin > then K’ 
is odd. If N is odd, then K” is even; the 1; occur in pairs and we can define 


4; 
Ax as 
id 
Aner = Anergo = At > Arxrgs = Aer 


(46) ” ” 
= Ne re A\i,v-1 = Ain = Aux’ e 


This also holds if N is even and if, in addition to the constant term and paired 
cosines and sines, we fit cos 7i = (—1)'(g’ = N/2). If N is even and we donot 
fit cos mi, we have K” odd. Then 


(47) Auerqt = Aixede = M1 > Aneds = Aes = Me > +s > Ai,w—2 


” ” 
= Mu,w-1 = Age’ ’—1) > Aw = Age’? 41) — —1. 


The general expression for the distribution of R in these cases has been found 
by one of the authors [2]. In this case the cumulative distribution function is 
1 minus 


Pr{R > R’} =D (-1)" | Vi |e — RYE, 
(48) = 


ne 2 ee 


where V; is found from a result of Lehmann [9] to be 


4(N+1) ” " iets 
(49) Vi = a sin at sin = I] Vor =), 

Mm. ” Qnf” ys , 
where f is such that 4% = cos —_ and the product on,’ is over the K’ terms 
Mj, excluding \1;, = 1. Hence, \1;, takes on K’ — 1 values in $(K’ — 1) pairs 
if K’ is odd and in 3(K’ — 2) pairs plus a single \1,;, = —1 if K’ is even. We can 


also write V; as 


LTT LT A ct 


enc 


PONE = 


TTT A SN 


SA ee 
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QhN+K’ ) _. _~af +f). a=") 
Vi NW . sin sin _—— sin —- wees 


' 4/ mh’ +f’) .. 0 Th’ = r(h' —f') 
5 sin —— —— 


5.3. Some special distributions of .R for L > 1. We have noted in (44) above 


QaLf” ae 
that \1,; = cos one —, where f” corresponds to a term not used in the estimation 





(50) 


“8 fin =e) If L, the lag, is 
) 

relatively prime to N, the distribution is the same as that given above for L = 1, 

except for the re-evaluating of the \; . In the article by R. L. Anderson [2], 

where only the constant term in m; was used, the \; for lag L were exactly the 

same as the \; for lag 1. However, this will not be the case for other terms 

used in m;. For example, consider lag 2 and N odd with m; consisting of the con- 


equations for m; , which was a function of < cos 





: 2ri ; . 
stant term plus terms in cos <™? and sin ani . In this case the \% for lag 1 are 


N N 
( 
| 4 67 (N — 1)r ” ; 
aa Vv cos pe eh cos == and the for lag 2 are 
as on cos oe cos oe -+, cos (V_- Lr 
s N ? N ’ . N ’ ’ a fe ° 


4 


Next suppose the highest common factor of L and N is a (as before, L = qa 
and N = pa, with p and q relatively prime). In this case 


47 
(51) en =H 


Since p and q are relatively prime, the results are the same as for g replaced by 1 
and L replaced by a. Each root is repeated a times. 





= 2L(p = 2) 

If we let N = 2L, % = cos rk = +1 or —1.” = +1 corresponds to these 
fitted terms in m;: i, cos a , sin aa S for g’, h’ even. X” = —1 corresponds 
to these terms: {cos ? = , sin ate \ for g’, h’ odd. Let L — n, be the number 
of terms pertaining to X” = +1 and L — nz be the number of terms for 
\” = —1. Then, as in [2], we have the density 

— (= Ra) + Ra) 


where ,R, was the notation used for lag L and p = 2. The cumulative function 
is the Incomplete Beta function, found by setting x = 3(1 — R’). 


= 3L(p = 
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” 


If we let N = 3L,% = cos a +1, —}. The fitted terms in m, corre- 


sponding to \” = 1 are {h cos a , sin _ \ for g’, h’ = 3m. Similarly, those 

corresponding to \” = —} have g’, h’ = 3m — 1 or 3m — 2. Let the number 

of fitted terms with X” = +1 be L — n, and with” = —4 be 2L — ne. Then 
_ R 4(ng—2) 71 4(n)—2) 

(53) on - Ct ee 








(3/2y"""- ‘B(Am ’ 4m) 


where ,R; > — 4. This cumulative function is also an Incomplete Beta function, 
found by setting x = 2(1 — R’)/3. 


N = 4L(p = 4) 

If N = 4L,% = cos ~ a = +1,0, —1. The fitted terms in m; corresponding 
tod” = lhavef” = Pd those for \’ = —1 have f” = 4m — 2; and those 
for” = Ohave f’ = 4m — 1 or 4m — 3. Let the number of terms in m; of each 


sort be L — n,, L — no, and 2L — nz, respectively. Then 


1 
i + Ryerte / yr (1 = yi 


y=0 


(54) D(R) ‘a+ R) - y(l + R)}*- dy, for R < 0, 
= ¢ 
(1 = R)hertes— [ yy a y)m2-) 
y=0 


-[Q + R) -y — RB) dy, for R > 0, 


where R is ,R, and c = T'(4[ni + m2 + nol) /[P(4ni1) PT (4n2) P(4n3) 20]. 

5.4. The exact distribution of .R when p ¥ 0. The joint distribution of the ob- 
servations for lag 1 when the null hypothesis is not true (po # 0) is (15), where 
Q is given by (45) with L = 1 and ,C = RV. V, R, {c;}(j = 1, --- , K’) area 
sufficient set of statistics for estimating o°, p, and {y;}(j = 1, --- , K’). Using 
the results given by Madow [11], it can be shown that the simultaneous dis- 
tribution of V and R is 


1 — p% 
ix’? ” -. ° 
2° TGK) 4/ TT (1 + p° = 2prry") 
j’=1 
where D(R) is the density function corresponding to (48). Integrating V from 0 
to ©, we obtain as the density for R 
(1 — p")(}K" — 1) ; - 
(56) pete ere (1 +p- 2pk)** 
II (1 + 6° — 2pr;-) 


7’=1 


(55) ViE-1g-Vtet—29R)/262 DP 


> (~ “as an Re" | Vi | 
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for Amii < R < Xm, where V; are given by (50). In the same way, one obtains 
the distribution of ,R for p  O when N = 2L, N = 3L, and N = 4L by multi- 
plying (52), (53), and (54), respectively, by 


o aK’" 
(57) (1 — pt te = 20k) 


i ae aa an , 
/ IT (1 + p° — 2pdss) 
7'’= 


where K” = m + no or m + m2 + 73. This method was used by Madow for 
residuals from the sample mean [12]. 


6. Moments. 


6.1. The exact moments of R. Most of the results of this section are straight- 
forward adaptations of earlier results for the case of u; constant. Hence, we shall 
omit the details of derivations. The moment generating function of V and C 
foro = lis 


1 on N 
$(t,t) = E(e*"*"") = —— . 


-——_—_-—f =e 
(58) E + p — 2t — 2(p + #) ds | 


jE 
The h moment of R = C/V is given by 
‘ 0 Vh—1 v1 ao 4 
(59) u(R) = [ I “e [ ‘| dt [J dy:, 
—0 dno co Ol” emo i=1 


with the {y;} restricted from being too large (not more than a certain amount 
larger than zero). In the case of independence, (p = 0), we have the following 
first two moments of R: 


, 1 < 
m(R) ==, DY Magers 


_ . 
j/’=K'+1 


(60) 2 N kK” 
AR) = seam No: + ayo 
H2( ) RK” (K” > 2) ities 1g + K” +2 [ur( )] 
If the \j,;-- are symmetrical (i.e. for each Ai,;- , there is a Aixn-7 = —A1,;--), the 


mean of R is 0. For example, if 1 and (—1)’ are fitted for N even, the mean is 0. 

6.2. Approximate moments of R when p = 0. Since R and V are independent 
[8] when p = 0, u’(R) = uw’(C)/u’(V). V is a sum of squares and its moments are 
the same as for x’ with N — K’ = K”’ degrees of freedom. Using methods similar 


to those given by Dixon [5], we see that the moment generating function for 
C is 


(61) g(t) = a(t) - Bt) - y(), 
where 

aN 
(62) a(i) = G) a) = AYA” — (204, 


y(t) = J] (1 — 2ta1;),and A =1+ V1 — 42. 
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; 2rf’ . . : 
In this case, \1,;, = cos — f includes all K’ terms corresponding to those in m; . 


4 


Since the first N derivatives of 8(t) are zero at t = 0, we can use 
2 TT. (1 — 2¢d,5)! 
(1+ V1 — 4e)" 


as an approximation to (61). This expression yields the exact moments of C 
up to order N. 





(63) d(t) = a(t)-y(t) = 


As a special case, consider K’ = 3, with Ai. = 1 and Ay2 = A13 = cos =. 
In this case 
(64) é3(t) = (1 — 2t cos 2) éu(t). 
Successive derivatives of (64) at t = 0 show that 
(65) un(R3) = E un(hiy — 2hQ cos ~ nia(R) | 


where P = yn(Vi)/us(1I ‘s) = (N — 8 + 2h)/(N — 3), Q = miaCVi)/ua(Va) = 
2/(N — 3), andh = 1,2,--- ,N. 

6.3. Approximate moment generating function of C and V when p ¥ 0. To obtain 
an approximate moment generating function for C and V when p ¥ 0, we utilize 
an approximation method given by Leipnik [10]. The exact moment generating 








function (58) with o° = 1 can be written as 
o 2 Qri 
(66) (to, t) = (1 — p*)pexp.— 2 Ytog | 1 +o? — 2% — 2¢ = |}. 
t=1 + 


where 6 =[];-[1 + p — 2to — 2(p + ther l, and j’ refers to the K’ fitted terms 
in m; . If the sum in the exponent of (66) is replaced by 


(67) [ s|1 -- p — 2t) — 2(p + t) cos | dx, 


and if (1 — p”) is replaced by 1, we obtain the approximate moment generating 
function 


—— I], 11 + &° — 2h — Ap+ 8 raz" 
[3(1 + p? — 2) + V(1 + p? — 2to)? — 4(p + 2)? )] 


7. Approximate distributions of R. 





7.1. The Pearson Type I (Incomplete Beta) distribution. The significance points 
of ,R can be found exactly from equation (48) for L = 1 and by integrating 
equations (52), (53), and oi for VN = 2L, 3L, and 4L, respectively. These exact 
probability integrals for N 2L, 3L, and 4L are simply sums of Incomplete 
Beta functions, and the ities points can be found in Pearson’s Tables of 


—~— ty 7m . 9 


CIRCULAR SERIAL CORRELATION COEFFICIENT 79 


the Incomplete Beta-Function [14] or in the Thompson tables [16]. However, the 
computation of the exact significance points for L = 1 and N > 4 by use of 
equation (48) is quite tedious and actually impossible for large N with present 
logarithm tables and readily available computing devices. Hence, approximate 
distributions are called for. 


The Type I approximation to the distribution of R is 


_( +R" 0- RB 
(69) JR) = ——~Srt B(p, @) 


where p and q are chosen so that the first two moments of this approximate dis- 
tribution agree with the first two moments of the exact distribution. It can be 
shown that each moment of the approximate distribution approaches the corre- 
sponding exact moment quite rapidly as N increases. On the basis of the ap- 
proximation, the probability a of the significance point R’ being exceeded can 
be found from the Incomplete Beta function. Thus 


s~i Ses i, 


(70) a = Pr{R > R’} = 1 — I.(p,q) = I2(p’, 7), 
where 

~ = an. [ p—l ee q-1 

(71) I.(p, @) Bip, g) Jo y” (1 — y)* dy, 


and x = (1+ R’)/2, 2’ = (1 — 2), p’ = gq, and q’ = p. Hence, R’ = 2x — 1 = 
1 — 22’. 
The parameters in (69) are taken to be 


(72) 2p = (1 + wi)(1 — w2)/me, 2 = (1 — wi)(1 — us) /ue, 


where po = po — (u1)° and pw; — ui(R) given in (60). Hence, when the distribu- 
tion of R is symmetric, ui = O and 2p = 2q = (1 -— u2)/ be « 

j In Section 3.1, we set up significance points for four special trends for which 
i = 0: 

(b) P = 2; (c) P = 2, 4; (d) P = 2, 3, 6; (e) P = 2, 12/5, 3, 4, 6, 12. 

The values of u: for these four trends are: 
(b) (V — 4)/[N(N — 2)], (c) 1/(N — 2), (d) 1/(N — 4), (e) 1/(N — 10). 
Naturally the third moments for these symmetric distributions are 0. The fourth 
moments are as follows: 


Trend (b) (c) ' (d) | (e) 
| | 
icin 3(N2 — 2N — 16) 3(N2 — 2N — 16) 3 3 
(NV +4)(N + 2)N(N — 2) | (N + 2)(N)(N — 2)(N — 4) | (V—2)(V —4) | (V—8)(N — 10) 
Incomplete 3(N — 4)? 3 3 3 
Beta N(N — 2)(N2— 8) N(N — 2) (N — 2)(N —4) | (V—8)(N — 10) 


We note that for (d) and (e), the fourth moments for the Incomplete Beta are 


exact and for (b) and (c), they approach the exact values quite rapidly as N 
increases. 
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In Section 3.2, we considered some significance points for the following single- 
period trends: P = 3, 4, 6, and 12. The values of 2p and 2q for these asymmetrical 
cases are 
(73) fe, 


_@W-34+ me 
D ——_—* 


D 
where A = cos =, E = (N — 1)(N — 4)—4A and D = (N — 3)(N — 1+ 4A) - 
(N — 1)(1 + 2a). 

Equation (69) has the drawback of using the range (—1, +1) instead of the 
true range of R, which varies between the last (smallest) \y to the first (largest) 


\ . For example, if N = 12 and we fit the constant, cos en and sin ~~ then 


3° 12’ 
2r V/3 ; 4r 1 
= = =a 2 h aah (a 
Ant 1, Ax2 = Ars = cos 19 2 and the range of R is( 1, cos 12 ) 
However, if we fit the constant —- cos mi = (—1)*, then Ay. = 1 and Ai2z = —1, 
the true range would be (-% >+ 5, +3), From these examples we see that the 


error in using the sean, range (—1, +1) varies according to the fitted 
terms in m;, and that the error is worse on one tail than on the other, unless 
symmetric terms are fitted. A more accurate approximation could be obtained 
by use of the exact curtailed range, but it was not thought desirable because the 
exact range rapidly approaches the approximate range as N increases. 

We might add that the significance point, R’, can also be calculated from the 
Inverted Beta (F) distribution, for which tables are given by Merrington and 
Thompson [13], Snedecor [15], and Fisher and Yates [6]. Cochran [4] has provided 
an approximate formula for z = 3 log. when n, and nz are not given in the 
F-tables. 

7.2. The normal approximation. It should be noted that R is asymptotically 
normally distributed for p = 0, as shown by the form of the characteristic func- 
tion. We have considered the normal approximation with mean u; (R) and 
variance pe (R). The variance of R was given in the previous section for the four 
special trends. For all single period trends, except P = 2, uw. = —(1 + 2a)/ 
(N — 3) and the variance is 
(VN —1+4+4)) 
(N — 1)(N — 3) 
where, as before, \ = cos (27/P). Further terms in an asymptotic expansion of 


the distribution would take account of higher moments of R as Hsu has done 
for the case of fitting only the mean (m; = a constant) [7]. 


(74) be = —(u1)’, 
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BAYES SOLUTIONS OF SEQUENTIAL DECISION PROBLEMS 


By A. WALD AND J. WoLFrow!ItTz 


Columbia University 


Summary. The study of sequential decision functions was initiated by one of 
the authors in [1]. Making use of the ideas of this theory the authors succeeded in 
[4] in proving the optimum character of the sequential probability ratio test. 
In the present paper the authors continue the study of sequential decision func- 
tions, as follows: 

a) The proof of the optimum character of the sequential probability ratio 
test was based on a certain property of Bayes solutions for sequential decisions 
between two alternatives, the cost function being linear. This fundamental 
property, the convexity of certain important sets of a priori distributions, is 
proved in Theorem 3.9 in considerable generality. The number of possible deci- 
sions may be infinite. 

b) Theorem 3.10 and section 4 discuss tangents and boundary points of these 
sets of a priori distributions. 

(These results for finitely many alternatives were announced by one of us 
in an invited address at the Berkeley meeting of the Institute of Mathematical 
Statistics in June, 1948)’ 

c) Theorem 3.6 is an existence theorem for Bayes solutions. Theorem 3.7 
gives a necessary and sufficient condition for a Bayes solution. These theorems 
generalize and follow the ideas of Lemma 1 of [4] 

d) Theorems 3.8 and 3.8.1 are continuity theorems for the average risk func- 
tion. They generalize Lemma 3 in [4] 

e) Other theorems give recursion formulas and inequalities which govern 
Bayes solutions. 


1. Introduction. In a previous publication of one of the authors [1] the decision 


problem was formulated as follows: Let X = {2;} (¢ = 1, 2,---, ad inf.) be 
a sequence of chance variables. An observation on X is given by a sequence 
x = {x,;} @ = 1, 2,--- , ad inf.) of real values, where x; denotes the observed 


value of X,; . A sequence x is also called a sample or sample point, and the totality 
M of all possible sample points x is called the sample space. Let G(x) denote the 
probability that X; < 2; fori = 1, 2,--- , ad inf.; i.e., G is the cumulative dis- 
tribution function of X. In a statistical decision problem G is assumed to be un- 
known. It is merely known that G is an element of a given class Q of distribution 
functions. There is given, furthermore, a space D* whose elements d represent 
the possible decisions that can be made in the problem under consideration. 





1A brief statement of some of the results of the present paper is to be found 
in the authors’ paper of the same name in the Proc. Nat. Acad. Sci. U. S. A., Vol. 35 (1949), 
pp. 99-102. 
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The problem is to construct a function d = D(z), called the decision function, 
which associates with each sample point x an element d of D* so that the decision 
d = D(x) is made when z is observed. 

Occasionally we shall use the symbol D to denote a decision function D(z). 
This will be done especially when we want to emphasize that we mean the whole 
decision function and not merely a particular value of it corresponding to some 
particular x. 

If d = D(x) is the decision function adopted and if = {xo} (¢ = 1, 2, ---) 
is the particular sample point observed, the number of components of x° we have 
to observe in order to reach a decision is equal to the smallest positive integer 
n = n(x°) with the property that D(x) = D(x’) for any x for which 7; = 21, -°-- , 
tn, = X,. If no finite n exists with the above property, we put n(x) = ©. If 
d(x) is equal to a constant d, we put n(x) = 0. We shall call n(x) the number 
of observations required by D when 2 is the observed sample. Of course, n(x) 
depends also on the decision rule D adopted. To put this in evidence, we shall 
occasionally write n(x, D) instead of n(x). If Do is a decision function such that 
n(x, Do) has a constant value over the whole sample space M, we have the classical 
non-sequential case. If n(x, Do) is not constant, we shall say that Do is a sequential 
decision function. 

In the remainder of this section we shall sketch briefly some of the fundamental 
notions of the theory without regard to regularity conditions. The latter will be 
discussed in the next section. 

In [1] a weight function W(G, d) was introduced whichexpresses theloss suffered 
by the statistician when G is the true distribution of X and the decision d is 
made. Let c(n) denote the cost of making n observations; i.e., c(n) is the cost 
of observing the values of X, , --- , X, . Then, if the decision function d = D(x) 
is adopted and G is the true distribution of X, the expected value of the loss due 
to possible erroneous decisions plus the expected cost of experimentation is 
given by 


(1.1) r(G, D) = [ WIG, D(x)] dG(x) + [ c{n(x, D)| dG(z). 


The above expression is called the risk when D is the decision function adopted 
and G is the true distribution. 

Let £ be an a priori probability distribution on Q; i.e., £ is a probability measure 
defined over a suitably chosen Borel field’ of subsets of @. Then the expected value 
of r(G, D) is given by 


(1.2) r(t, D) = / r(G, D) dé. 
Q 


* A Borel field is an aggregate of sets such that a) the null set is a member of the field, 
b) the complement with respect to the entire space (here ) is a member of the field, c) 
the sum of denumerably many members of the field is itself in the field. 
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The above expression is called the risk when é is the a priori distribution on Q 
and D is the decision function adopted. 

We shall say that the decision function Dy is a Bayes solution relative to the 
a priori distribution & if 


(1.3) r(é, Do) S r(é, D) for all D. 


If there existed an a priori distribution on Q and if this distribution were known, 
we could put & equal to this a priori distribution and a Bayes solution relative to 
£ would provide a very satisfactory solution of the decision problem. In most 
applications, however, not even the existence of an a priori distribution can be 
postulated. Nevertheless, the study of Bayes solutions corresponding to various 
a priori distributions is of great interest in view of some results given in []]. 
It was shown in [1] that under rather general conditions the class C of the Bayes 
solutions corresponding to all possible a priori distributions — has the following 
property: If D, is a decision function that is not an element of C, there exists 
a decision function D, in C such that 


(1.4) r(G, Dz) <= r(G, D,) for all G 
and 
(1.5) r(G@, Ds) < r(G, D,) for at least one G. 


It was furthermore shown in [1] that under general conditions a minimax 
solution Dy of the decision problem is also a Bayes solution corresponding to 
some a priori distribution £. By a minimax solution we mean a decision function 
Do such that, for all D 


(1.6) Sup r(G, Do) S Sup r(G, D). 
G G 


2. Regularity conditions and other assumptions. We shall make the following 
assumptions: 

AssuMPTION 1. The chance variables are identically and independently distributed. 
The common distribution is either discrete or absolutely continuous. 

Let p(a| F) denote the elementary probability law of X; when F is the dis- 
tribution of X; ; i.e., when F is discrete, p(a | F’) is the probability that X,; = a, 
and when F is absolutely continuous, p(a | F) is the probability density of X; 
at a. 

In the space M of sequences x let B be the smallest Borel field which contains 
all sets of points x which are defined by the relations 


ri <a; 1 = 1,2, --- ad inf., 


where the a; are real numbers or + ©. Each admissible* F induces a probability 
measure F*(B) on M; the totality of these probability measures is 2. Let H* 





3 An F or F* is admissible if F* is in Q. 
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be a given Borel field of subsets of 2. The only subsets of 2 which we shall dis- 
cuss in this paper will be members of H*, and all probability measures on Q 
which we shall discuss will be measurable (H*). This will henceforth be assumed 
without further repetition. 

Let A* be any set in H*, and A the set of F which corresponds to the F* in 
A*. The sets A form a Borel field, say H. By definition, the probability measure 
of a set A according to a probability measure £(H*) on Q is to be the same as the 
probability measure of A* according to &. 

Let M X Q be the Cartesian product of M and Q ([5], page 82), and K be the 
smallest Borel field of subsets of M X 2 which contains the Cartesian product 
of any member of B by any member of H%*. 

For a given decision function d = D(x), W(F, D(x)) is a function of F and z. 
Hereafter in this paper we shall limit ourselves to functions D(x) such that 
W(F, D(x)) is measurable (K), and n(x, D) is measurable (B). 

It is true that in Section 1, W was given as a function of G, the distribution of 
X. Because of Assumption 1, G = F*, and there is a one-to-one correspondence 
between F and F*. Thus we may, in appropriate places, interchange them freely. 

AssumpTION 2. For every real a, except possibly on a Borel set’ whose ‘probabil- 
ity is zero according to every admissible F, p(a | F) exists and is a function of a and 
F whichis measurable (K). If the admissible distributions F are discrete, there exists a 
fixed sequence {b;} (¢ = 1,2, --- , adinf.) of real values such that >> {1 p(b; | F) = 
1 for all admissible F. 

ASSUMPTION 3. W(F, d) is bounded. For every d in D*, W(F, d) is a function 
of F which is measurable (1). 

In what follows é will always denote a probability measure (H*) on 2. Thus 


WE, d) = [ W(F, d) dé 


exists. 
ASSUMPTION 4. The function c(n) = cn. Without loss of generality we may 
take c = 1, so that c(n) = n. 
We shall introduce the following convergence definition in the space D*: 
the sequence {d;} converges to dy if 
lim W(F, d:) = W(F, do) 
4-200 
uniformly in the admissible F’s. 
ASSUMPTION 5. The space D* is compact in the sense of the above convergence 
definition. 
One can easily verify that, if lim d; = do , then 


$00 


lim W(é, di) = W(&, do); 


‘00 





‘ A Borel set is a member of the smallest Borel field which contains all the open sets of 
the real line. 
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i.e., W(E, d) is a continuous function of d. Thus, because of Assumption 5, the 
minimum of W(é, d) with respect to d exists. 
We shall now show that, under the above conditions 


(2.1) [ WIF*, D(x)] dF*(x) 


exists and is a function of ’* measurable (H*). For any j let R; be the set in B 
such that n(z, D) = j. Then it is enough to show that, for any 7, 


(2.2) [ WIF*, D(a) dF*(2) 


exists and is a function of F* measurable (H*). 
In the discrete case, the integral (2.2) is equal to the sum® 


(2.3) DL  WIF*, D(z)\p(ai | F) --- p(w; | F). 


For fixed values of 2,,---, x;, the expression under the summation sign is 
obviously a function of F* measurable (H*). Since, because of Assumption 2, 
there are only countably many points (2, --- , 2;) in R;, the sum (2.3) must 
be a function of F* measurable (H*). 

In the absolutely continuous case, the integral (2.2) is equal to (2.4) 


(2.4) [ WIF*, D(x] I p(x; | F) dv(j) 


where v(j) is Borel measure in the j-dimensional Euclidean space. The integrand 
is measurable (K). Hence, the integral (2.4) exists and is a function of F* measur- 
able (H*) (see [5], Chapter III, Theorems 9.3 and 9.8). 


3. Some results concerning Bayes solutions. If ¢ is the a priori probability 
measure on Q, the a posteriori probability of a subset w of Q for given values 


%1,°** , Um Of the first m chance variables is given by 


/ p(x | F) era D(a'm | F) dé 
ie 


(3.1) E(w | g, vy , sess , Lm a — ——— 
/ p(ai| F) --+ pam! F) dé 
a 
Let 
(3.2) po(é) = Min Wéé, d). 
d 


For any positive integral value m, let p»(€) denote the infimum of r(é, D) with 
respect to D where D is restricted to decision functions for which n(x, D) < m 
for all x. For any positive integer m, let d = D(x) denote a decision function 


5 Because of the definition of R; we may, in the expressions (2.3) and (2.4), proceed as 
if R; were a Borel set in j-dimensional Euclidean space. 
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D for which n(x, D) S m for all x. Thus, we can write 


(3.3) pm(é) = Inf r(é, D™) (m = 1, 2, --- , ad inf.). 
Let 
(3.4) p(é) = Inf r (, D). 

D 


We shall first prove several theorems concerning the functions po(£), pm(€), 


and p(é). 
THEOREM 3.1. The following recursion formula holds: 


(3.5) pm4i(é) = Min | et, + [. pm(Ea) p(a | €) aa | 


(m = 0, 1, 2, --- , ad inf.) 


where 
(3.6) fa(w) = &(w| &, a) and p(a |) = [ reir) dé. 


Proor: Let px (€) (m = 1, 2, --- , ad inf.) denote the infimum of r(é, D) with 
respect to D where D is subject to the restriction that n(x, D) 2 1 and S m for 
all x. Clearly, 


(3.7) pmsi(é) = Min[po(é), pm+i(é)]. 


Let pm(é | a) denote the infimum with respect to D of the conditional risk (con- 
ditional expected value of W[F, D(x)] + n(x, D)) when the first observation 
z, on X; is a and D is restricted to decision functions for which n(x, D) = 1 and 
< m for all x. Let D(m) be the temporary generic designation of such a decision 
function. Let D(m | a) be the decision function which is obtained from D(m) 
when the first observation is a. Finally let r(é, D | a) be the conditional risk when 
the a priori distribution function is &, D is the decision function and requires at 
least one observation, and the first observation is a. We then have that 


r(é, D(m + 1)|a) = r(&., Dim + 1] a)) +1. 
Hence 
(3.8) pm+ilé | a@) = pm(t.) + 1. 


The unconditional quantity pn+i(£) must clearly be equal to the average value 
of the infimum of the conditional risk. Thus we have 


(3.9) paul) = | prulE| a)p(a| 8)da. 





* If the distribution of X is discrete, the integration with respect to a is to be replaced 
by summation with respect to a. This remark refers also to subsequent formulas. 
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Equation (3.5) follows from (3.7), (3.8) and (3.9). 
THEOREM 3.2. The function p(&) satisfies the following equation: 


(3.10) e(—) = Min | te), f p(Ea)p(a | §) da + | 


The proof of this theorem is omitted, since it is essentially the same as that of 
Theorem 3.1. 


THEOREM 3.3.’ The following inequalities hold: 


2 
3.11) 0S pulé) — of) S"° (m= 1,2, +++ , ad int) 
where Wo is the least upper bound of W(F, d). 
Proor: Let {D;} (¢ = 1, 2, --- , ad inf.) be a sequence of decision functions 


such that 


(3.12) lim r(é, Ds) = pl). 


Let, furthermore, P;(~) denote the probability that at least m observations will 
be made when D; is the decision function adopted and & is the a priori probability 
measure on &. Since p(£) < Wp and since 


(3.13) r(é, D;) 2 mP,(é), 
it follows from (3.12) that 


(3.14) lim sup P,() < =. 

Let D7 be the decision function obtained from D; as follows: D?(r) = D,(z) 
for all x for which n(x, D;) S m. D7? (x) is equal to a fixed element dy for all z for 
which n(x, D;) > m2 


Clearly, 

(3.15) r(é, Di) S r(€, Di) + Pi&lé)Wo. 
From (3.12), (3.14) and (3.15) it follows that 

(3.16) lim sup r(é, D?) Se) + °. 


Since pm(€) cannot exceed the left hand member of (3.16), the second half of 
(3.11) follows from (3.16). The first half of (3.11) is obvious. 





7 This theorem is essentially the same as Lemma 2.1 in [6]. 

8 We verify that W(F, D7’) is measurable (K), as follows: Consider the set V of couples 
(F, z) such that W(F, D?(x)) < c, where c is some real constant. We want to show that 
VeK. For this purpose let Vo be the set of couples (F, z) such that W(F, D;(z)) < c. Then 
VoeK. Let V; be the set of z’s such that n(z, D;) S m. Then Vie B, (Q K V:) = VaeK, 
VoV2eK. Let Vi = M — V, . For every zeV3 we have W(F, D7 (x)) = W(F, do). Let V4 be 
the set of F’s such that W(F, do) < c. Then V, e H by Assumption 3. Finally we have V = 
VoVe + Vi X V3, so that VeK. 
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rm . . ory ‘ ° : 9 
The immediate consequence of Theorem 3.3 is the relation 


(3.17) lim pm(~) = p(€). 
THEOREM 3.4. Jf & and & are two probability measures on Q such that'® 
&1(w) < 
(3.18) ta(w) = 1 + ¢ for all w, 
then 
(3.19) p(fi) S (1 + e)p(€2). 
Proor: It follows from (3.18) that 
(3.20) r(é:, D) S (1 + &)r(é&, D) for all D. 


Hence, (3.19) must hold. 
The above theorem permits the computation of a simple and in many cases 


useful lower bound of | p(éa)p(a | &) da as follows: 


For any real value a, let ¢, be a non-negative value (not necessarily finite) de- 
termined such that 


E(w) 


(3.21) Eau) = 1+ «e for all w. 


Then 





(22) [ot plale daz f° p(ale) da =o(@) [ PO!® da 


Since eg 2 O and since po(é) 2 p(é), we obviously have 


p(é) -[1 . [ mle da fot 


” p(a | €) 
(3.23) p(é) ——eone GM ka 


Lol + € 


IV 


Hence, we obtain the inequality 





(324) [ o(€) pal) da = ole) — ald) [ “fire ia| 


An upper bound of the left hand member in (3.24) is obtained by replacing 
p by po ; 1.e., 


(3.25) [, etée)n(a| 8) da < | polGa)o(a | 8) da. 


* A proof of (3.17) is contained implicitly in the work of Arrow, Blackwell and Girshick 
((2], Section 1.3). 
” The left member of (3.18) is defined to be equal to 1 when é:(w) = &(w) = 0. 
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The bounds given in (3.24) and (3.25) may be useful in constructing Bayes 
solutions, since the following theorem holds: 
THEOREM 3.5. If 


(3.26) po(~) > [ po(Ea)p(a | &) da + 1, 
then p(E) < po(§). If 
(3.27) po(é) E * [ me 2 ia | <1, 


then p(E) = pol). 

The above theorem is an immediate consequence of (3.10), (3.24) and (3.25). 

A decision procedure relative to a given a priori probability measure & will 
be given with the help of the function p(€) as follows: If p(&) = po(£o), take a 
final decision d for which W (£ , d) is minimized. If p(&o) < po(o), take an observa- 
tion on X, and compute the a posteriori probability measure £,. If p(é) = 
po(€,), stop experimentation with a final decision d for which W(é, , d) is minim- 
ized. If p(&:) < po(&1), take an observation on X, and compute the a posteriori 
probability measure £ corresponding to the observed values of X, and X2, and 
so on. The above decision procedure will be shown later to be a Bayes solution. 
Theorem 3.5 permits one to decide whether p(~) < po(&) or = po() whenever 
£ satisfies (3.26) or (3.27). Theorem 3.5 will be useful when the class of all £’s 
for which neither (3.26) nor (3.27) holds is small. 

For the purposes of the next theorem let D designate the decision procedure 
described in the preceding paragraph. (We shall shortly show that D is a decision 
function in the sense of our definition.) 

Let D° be the decision procedure where the first observation is taken and then 
one proceeds according to D. 

We shall now prove that D and D° are Bayes solutions. More precisely, we 
shall prove the following theorem: 

TueoreM 3.6. For any &, D and D° as defined above are decision functions. 
Let D be any decision function for which n(x, D) 2 1 and let 


p*(é) = Inf r(é, D). 
D 
Then 
r(é, D) = p(é) 
and 


r(é, D®) = p*(é). 


1tThis theorem follows also from some earlier more general existence theorems ((6], 
Theorems 2.4 and 3.3). (See also [4], Lemma 1.) The validity of Theorem 3.6 was proved 
also by Arrow, Blackwell and Girshick [2]. 


we 


((6}, 


oved 


BAYES SOLUTIONS 91 


In view of this theorem, the operation “infimum with respect to D” in the 
definitions of p(é), and p*(€) can be replaced by “minimum with respect to D.” 

First we shall establish the measurability properties of D and D°. Since the 
proofs are similar, we restrict ourselves to consideration of D. Let é2,.... z_, be 
the a posteriori distribution (3.1). From the (B) measurability of po(éz,.....2,) 
and p(éz,,...z_) it follows easily that n(z, D) is measurable (B). It remains to 
prove that W(F, D(x)) is measurable (K). For this purpose, let L' = (di yore He) 


1 : : . 
be a sequence - dense in D*, i.e., for any d ¢ D* there exists a g ¢ D* such that 
a 


g « L' and | W(F, d) — W(F,g)| < uniformly in F. (The existence of such 


a sequence follows from Assumption 5.) Let now D,(x) be a decision function 
defined as follows: 


n(z, D;) = n(x, D). 


Suppose n(x, D) = m when the observations are 2, --- , tm. We define D;(x) 
to be such that D,(x) is an element of L’ and 
(3.28) Fn... ’ Dj(x)) — Min W (Ez, feoes zm) d), 

deL* 


i.e., D(x) takes the minimizing value of d. For any fixed d, the set of x’s satisfying 
the equation D,(x) = d is without difficulty shown to be (B) measurable. Since 
D(x) assumes only a finite number of values in D*, it follows from Assumption 3 
that W(F, D,(a7)) is measurable (K). Now 

lim W(F, Di(x)) = W(F, D(x)), 


so that W(F, D(x)) is measurable (K). 
We shall now prove that D is a Bayes solution, i.e., that 


(3.29) p(t) = r(é, D). 
In a similar way it can be proved that 
(3.30) p*(é) = r(é, D’). 


If po(é) = p(é), there can be no better decision function (from the point of 
view of reducing the risk) than D, i.e., D is a Bayes solution. Suppose then that 


(3.31) po(—) > p(€). 


_ If (8.31) holds and D is not a Bayes solution, there exists a decision function 
D, such that 


(3.32) r(é, D) < r(é, D) 


and 


(3.33) r(¢, Dy) < ee 
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Now D, must require that at least one observation be taken, else (3.33) could 
not hold. Thus D and D, both require at least one observation. 

Suppose one observation is taken. Let r(é, D | a) denote the conditional risk 
of proceeding according to D when & is the a priori distribution and a is the 
first observation. For a given D we have that r(é, D | a) is a function only of 
é,. In particular r(é, D |a) and r(é, D, | a) are functions only of &. 

We can now apply to r(é,D|a) and r(é, D, |a) the same argument that 
was applied above to r(é, D) and r(é, D,), and conclude again as follows: when- 
ever po(a) = p(é.) (when one takes no more observations according to D), 
taking additional observations cannot diminish the conditional risk below 
r(é, D| a) (D, may require an additional observation without having 


r(é, Di | a) > r(é, D | a). 


This can happen when po(.) = p*(Ea)). Whenever po(E.) > p(t.) (when D re- 
quires us to take another observation) two cases may occur: either a) D, requires 
us to take another observation, in which case its decision is the same as that of 
D, or b) D, requires us to stop taking observations. There exists then another 
decision function whose conditional risk is less than 


po(Ea) + p(Ea) 
2 


Both this decision function and D require that another observation be taken. 
We conclude that up to and including the first observation, D coincides either 
with D, or with another decision function D, whose risk is not greater than that 
of D, . 

We continue in this manner for 2, 3, --- observations. The above argument is 
always valid because of Assumption 4 and because the past history of the process 
(the sequence of observations) enters only through the a posteriori probability. 
Thus we conclude that for any positive integer k there exists a decision function 
D, such that up to and including the k-th observation D gives the same decision 
as D, and the risk corresponding to D, does not exceed the risk corresponding 
to D, . Since lim,» r(é, D,) = r(é, D), (3.32) cannot hold. Hence (3.29) holds and 
D is a Bayes solution. 

For any probability measure — on 2 one of the following three conditions 
must hold: 

(1) Ming W(é, d) < r(é, D) for any D for which n(x, D) = 1. 

(2) Ming W(é, d) S r(é, D) for all D for which n(x, D) 2 1, and the equality 
sign holds for at least one D with n(x, D) 2 1. 

(3) There exists a D with n(x, D) 2 1 such that Ming W(é, d) > r(é, D). 

In view of Theorem 3.6, the conditions (1), (2) and (3) can be expressed by: 
(1) po(—) < p*(&), (2) po(—) = p*(E) and (3) po(—) > p*(é), respectively. 

We shall say that a probability measure é on Q is of the first type if it satisfies 
(1), of the second type if it satisfies (2), and of the third type if it satisfies (3). 
Since the a posteriori probability defined in (3.1) is also a probability measure 
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on @, any a posteriori probability measure will be one of the three types men- 
tioned above. 

We shall now prove the following characterization theorem: 

THeorEM 3.7.” A necessary and sufficient condition for a decision function 
d = Do(x) to be a Bayes solution relative to a given a priori distribution &) is that 
the following three relations be fulfilled for any sample point x, except perhaps 
on a set whose probability measure is zero when & is the a priori distribution in Q: 


(a) For any m < n(x, Do), the a posteriori distribution &(w | & , 11, -++ , Xm) is 
either of the second or of the third type, 
(b) For m = n(x, Do), the a posteriori distribution &(w | & , 21, +++ , 2m) ts either 


of the first or the second type, 
(c) For m = n(x, Do), we have 


Min W(€ey,..2m > @) = W(&ey...42m » Do(x)) 
d 


where éz,,...2m Slands for an a priori distribution that is equal to the a posteriori 
distribution corresponding to & ,%1,°*: ,Um- 

Proor: We shall omit the proof of the sufficiency of the conditions (a), (b) 
and (c), since it is essentially the same as that of Theorem 3.6. To prove the 
necessity of these conditions, let d = Do(x) be a decision function and let M* 
denote the set of all sample points x for which at least one of the relations (a), 
(b) and (ec) is violated. First, we shall show tht M* is a set measurable (B). 
Let M7 be the set of all x’s for which (a) is violated, M? the set of all x’s for 
which (b) is violated, and Mj the set of all x’s for which (c) is violated. Clearly. 
M* is shown to be measurable (B) if we can show that M7(i = 1, 2, 3) is meas- 
urable (B). Let Mi,(r = 1, 2, --- , ad inf) denote the subset of M7 for which 
the first violation of the corresponding condition occurs for the sample x, , --- , 2. 
We merely have to show that Mj, is measurable (B) for all 7 and r. The meas- 
urability of M3, follows from the fact that Ming W(Eéz,....z,, @) and 


W[Ez1..02¢ » Do(x)] 


are functions of + measurable (B). To show the measurability of Mj, and M3, ,, it 
is sufficient to show that the set of all samples 2, --- , x, for which &:,,...,2, is 
of type 7(7 = 1, 2, 3) is measurable (B). But this follows from the fact that 
po(és,,....2,) and o* (Ee _ z,) are functions of (a, --- , 2) measurable (B). Hence, 
M* is proved to be measurable (B). 

For any x in M* let m(zx) be the smallest positive integer such that at least 
one of the relations (a), (b) and (ec) is violated for the finite sample 


U1, %25°** 5 Lm(z) - 
Clearly, if x is a point in M*, then also any sample point y is in M* for which 
Yi = 1, °°, Ym) = Lm) - Let x” be any particular sample point in M* and 
let r(& , Do, x1, --~ , Xm) denote the conditional risk when £ is the a priori 


12 See also the proof of Lemma 1 in [4]. 
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° ° e ° e ee e e > r Oy 
distribution in Q, Dy is the decision function adopted and the first m(x") observa- 


° 0 0 : : 0 0 
tions are equal to 11, --* , Ami) , respectively; i.e., r(f, Do, 1, +++ 5 Lmce0)) 
is the conditional expected value of W(F, Do(x)) + n(x, Do), when £& is the 

> an ° ° * ° ie ‘ 0 0 
a priori distribution in Q, Do is the decision function adopted and 21 , +++ , Xn¢20) 


are the first m(x°) observations. 

Let D,(x) be the decision function determined as follows: for any x not in | 
M* we put D,(x) = Do(x). For any x in M*, let n(x; , D:) be equal to the smallest 
integer n(x) = m(x) for which 


Pol Es;,..020 (27) = pléz, teees — 


and the value of D,(x) is determined so that condition (c) of our theorem is 
fulfilled. Since, for any positive integer m, the subset of 17* where m(x) = m 
is (B) measurable, D,(x) has the proper measurability properties. Applying 
Theorem 3.6, we see that 


(3.34) r(& ’ D, ie Lm(z) ) = p(éz, peesd mesun? 


for any x in M*. On the other hand, since Dp violates at least one of the condi- 
tions (a), (b), and (ce) at every point z in M*, we have 


(3.35) r(fo ’ Do peg Lm(z)) > p(Es;,.20c2)) 
for every x in M*. If the probability measure of M* is positive when & is the 
a priori probability measure, the above two relations imply that 

r(& ? Do) > r(& ? D,). 


Thus, Do is not a Bayes solution and the proof of Theorem 3.7 is complete. 
We shall now prove the following continuity theorem.” 
THeoreM 3.8. Let {§;} (¢ = 0,1, 2, --- , ad inf.) be a sequence of probability 
measures on Q such that 





(3.36) lim ed = 1 uniformly in w. 
imo £o(w) 

Then 

(3.37) lim p(E:) = (bs. 


Proor: It follows from (3.36) that for any e > 0, we have for almost all 
values 7 


Ei(w) <1+eand bo(w) <1+ efor all w. 


£o(w) £i(w) 


Our theorem is an immediate consequence of (3.38) and Theorem 3.4. 


(3.38) 





13 A proof of this theorem for finite 2 was given by G. W. Brown and is included in [2]. 
See also Lemma 3 in [4]. 
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A stronger continuity theorem is the following: 
THEOREM 3.8.1. Let {&}, (¢@ = 0, 1, 2, --- , ad inf.) be a sequence of probabitity 
measures on Q such that 


lim &:() = f(w) 


uniformly in w. Then (3.37) holds. 
Proor: It follows from (3.11) that 


jim Pm(E) = p(é) 


uniformly in & Hence it is sufficient to prove that, under the conditions of the 
theorem, 


lim Pm(éi) = pm(E) 


for any m. Let D”™ (x) denote a decision function for which n (x, D”) S m for 
all x. It follows that, for a fixed m, r(F, D”) is bounded, uniformly in F and D™ 
(Assumptions 3 and 4). From the hypothesis on {é;} it then follows that 


lim r(é:, D") = r(g , D”) 


uniformly in D”. From this the desired result follows readily. 

A class C of probability measures — on © will be said to be convex if for any 
two elements & and & of C and for any positive value \ < 1, the probability 
measure — = Ak, + (1 — A) & is an element of C. 

For any element dy of D, let C;,4, denote the class of all probability measures 
t of type 7 (¢ = 1, 2, 3) for which W(é, do) = Min W(é, d). Let Ca denote the 


set-theoretical sum of C;,4 and C2,4. We shall now prove the following theorem. 
THEOREM 3.9. For any element d, the classes C,,4 and Cz are convex.” 
Let & and & be two elements of Ci,4. Then for any decision function D(x) 
which requires at least one observation we have 


(3.39) W(é,d) < r(&, D) and W(&,d) < r(&,d). 
Let € = AE + (1 — A) & where XQ is a positive number <1. Clearly, 
(3.40) W(é, d) = \W(&,, d) + (1 — \) We, d) 

and 

(3.41) r(é, D) = Arf, D) + (1 — A) r(&, D). 

From (3.39), (3.40) and (3.41) we obtain 

(3.42) W(é, d) < r(&,D) and Wéé,d) = Min W(é, d*). 


Hence é is an element of C,¢ and the convexity of Ci,a is proved. The convexity 
of Cz can be proved in the same way by replacing < by S in (3.39) and (3.42). 


4 See also Lemma 2 in [4]. 
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We shall say that a set L of probability measures £ is a linear manifold if 
for any two elements & and & of L, & = a& + (1 — a) & is also an element of 
L for any real value @ for which ag + (1 — a@) & is a probability measure. A 
linear manifold L will be said to be tangent to Ca if the intersection of L and 
(,4 is not empty, but the intersection of LZ and Ci, is empty. 

For any decision function D(x) and for any element d of D*, let L(D, d) 
denote the linear manifold consisting of all — which satisfy the equation 


(3.43) W(é, d) = r(é, D). 


THEOREM 3.10. Let & be an element of Co,a and let Do(x) be a decision function 
that requires at least one observation and is such that W(& , d) = r(& , Do). Then 
the linear manifold L(Do , d) ts tangent to Ca. 

PRooF: & is obviously an element of L(Do, d). Thus the intersection of L(Dp , d) 
and C2,a is not empty. For any element & of Ci,a we have W(é& , d) < r(&, D) 
for any D that requires at least one observation. Hence, W(é, ,d) < r(& , Dy) 
and, therefore, &; cannot be an element of L(D,y , d). This proves our theorem. 


4. Applications to the case where © and D* are finite. In this section we shall 
apply the general results of the preceding section to the following special case: the 
space Q consists of a finite number of elements, Ff, , --- , /. (say), and the space 
D* consists of the elements d, , --- , d; where d; denotes the decision to accept 
the hypothesis H; that F; is the true distribution. Let 


(4.1) W(F;,d;) = Wi; = Ofori = j and >0 fori # j. 


It will be sufficient to discuss the cases = 2 andk = 3, since the extension to 
k > 3 will be obvious. We shall first consider the case / = 2. In this case any 
a priori distribution £ is represented by two numbers g; and g2 where g; is the 
a priori probability that /; is true (¢ = 1, 2). Thus, g; 2 0 and g + ge = 1. 
Let £; denote the a priori distribution corresponding to g; = 1 (7 = 1, 2). Clearly 
Ca, contains & but not & , and Ca, contains & but not & . Because of Theorems 
3.9 and 3.7, Ca, and Ca, are closed and convex. Furthermore, we obviously 
have 


(4.2) GoW x = NW. for all E in Ca, 
and 
(4 3) goWo = MW 12 for all E in Ca, ° 


Let = (gi, g2) be the a priori distribution for which 
(4.4) g2W a = giWi ° 


It follows from (4.2) and (4.3) that there exist two positive numbers c’ and 
c’’ such that 


(4.5) O<c <g2Sc" <1 
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and such that the class Ca, consists of all for which g. S c’, and the class Ca, 
consists of all — for which g. 2 c”. 

Thus, the following decision procedure will be a Bayes solution relative to 
the a priori distribution & = (gq: , go): If ge Sc’ or = c’’, do not take any observations 
and make the corresponding final decision. If c’ < gz < c’’, continue taking observa- 
tions until the a posteriori probability of Hz is either 2 c” or S c’. If this a 


posteriort probability is = c’’, accept H, , and if it is S c’, accept Hy, . 

The a posteriori probability of H. after the first m observations have been 
made is given by 
16 ae ee. 

o "gpa | F1) «++ p(tm| Fi) + gep(ar! Fe) +++ pam | Fe)’ 

If c’ < ge < c” and if the probability (under F, as well as under F2) is zero that 
Jom = c’ or = ec” for some m, then it follows from Theorem 3.8 that the above 
described Bayes solution is essentially unique; i.e., any other Bayes solution 
can differ from the one given above only on a set whose probability measure 
is zero under both F; and F?2 . 

Provided that at least one observation is made, one can easily verify that the 
above described Bayes solution is identical with a sequential probability ratio 
test for testing H» against H, . The sequential probability ratio test is defined 
as follows (see [3]): Two positive constants A and B (B < A) are chosen. Ex- 
perimentation is continued as long as the probability ratio 


P2m = p(x | 9) ee D(Im | |e) 
aie Pim P(x | Fi) +--+ p(tm| Fi) 


satisfies the inequality B < <A.lf = A, accept H2. If < B, accept 
lm lm lm 

H,. The Bayes solution described above coincides with this probability ratio 

test for properly chosen values of the constants A and B. 

The results described above for k = 2 are essentially the same as those con- 
tained in Lemmas 1 and 2 of an earlier publication [4] of the authors. 

We shall now discuss the case k = 3. Any a priori distribution £ can be repre- 
sented by a point with the barycentric coordinates g; , gz and g;, where g; is 
the a priori probability of H(z = 1, 2, 3). The totality of all possible a priori 
distributions & will fill out the triangle 7 with the vertices 0; , 02 and 0; where 
0; represents the a priori distribution corresponding to g; = 1 (see Figure 1). 

Clearly, the vertex 0; is contained in Ca, . Thus, because of Theorem 3.9, 
Ca,(i = 1, 2, 3) is a convex subset of 7 containing the vertex 0; , as indicated 
in Figure 1. 

If one of the components of — = (91, ge, gs) is zero, say g; = 0, then H; can 
be disregarded and the problem of constructing Bayes solutions reduces to the 
previously considered case where k = 2. Thus, in particular, the determination 
of the boundary points P; , P2,--- , Ps of Ca,, Ca, and Ca, which are on the 
boundary of the triangle 7’, reduces to the previously considered case, : = 2. 
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It follows from Theorems 3.8 and 3.9 that the intersection of Ca; with any 
straight line 7; through 0; is a closed segment. One endpoint of this segment 
is, of course, 0;. Let B; denote the other endpoint. It follows from Theorem 
3.7 that B; must be a point of C24, . Any interior point of 0;B; can be shown 
to be an element of C;,a,. The proof of this is very similar to that of Theorem 
3.9. 

We shall now show how tangents to the sets Ca, , Ca, and Ca, can be con- 
structed at the boundary points P,, P.,--- , Ps. Consider, for example, the 
boundary point P; of Ca, that lies on the line 0, 0, . Let £ be the a priori distribu- 
tion represented by the point P, . Since the a priori probability of Hy is zero 
according to £ , we can disregard H; in constructing Bayes solutions relative 
to & . Let D,(x) be a sequential probability ratio test for testing H, against H, 


0, 


nU 


a 
a0 


0. 0; 
Fig. 1 


which requires at least one observation and which is a Bayes solution relative 
to & . Since & is a boundary point, such a decision function D, exists. Thus, we 
have 


(4.8) W(é ; d;) = r(é ’ D,) = Inf r(g > D). 
D 
Let a;; denote the probability of accepting H; when H; is true and D, is the 


decision function adopted. Let, furthermore, n; denote the expected number 
of observations required by the decision procedure when F; is true and D, 


is adopted. Then, for any a priori distribution § = (91, go, gs) we have 
(4.9) r(& Di) = 22 gsWijaig + DU gins 

$5) + 
and 


(4.10) We, ad) = DgiWa. 





y 
it 


ve 
we 


er 
D 


BAYES SOLUTIONS 99 


Thus, the linear manifold L(D,, d,) is simply the straight line given by the 
equation 


(4.11) DV gWa = LV gi Wisous + Do gins. 
% 457 + 


This straight line goes through P, and, because of Theorem 3.10, it is tangent 
to Ca, . Tangents at the same points P; , --- , Ps can be constructed in a similar 
way. 

The convexity properties of the sets Ca,(¢ = 1, 2, --- ,k) were established by 
the authors prior to the more general results described in Sections 2 and 3 and 
were stated by one of the authors in an address given at the Berkeley meeting 
of the Institute of Mathematical Statistics, June, i948. More general results 
when 2 and D* are finite, admitting also non-linear cost functions, were obtained 
later by Arrow, Blackwell and Girshick [2]. 
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ON THE DISTRIBUTIONS OF MIDRANGE AND SEMI-RANGE IN 
SAMPLES FROM A NORMAL POPULATION 


K. C. S. Privat 


University of Travancore, Trivandrum. 


1. Summary. In this paper the simultaneous distribution of midrange and 
semi-range has been obtained and used to derive the distributions of midrange 
and semi-range in samples taken from a normal population. 


2. Introduction. The concept of ordering a sample has given rise to innumer- 
able problems for statistical investigation. Several authors have contributed to 
the study of ordered individuals and, in particular, to the study of extreme indi- 
viduals, their sum and difference in samples from a normal population. L. H. C. 
Tippett [1] has studied the first four moments of the range and has tabled the 
mean-range for sample size ranging from two to thousand. Student [2] has 
determined the nature of the distribution of range for particular sample sizes 
by purely empirical methods. T. Hojo [8] has compared the standard error of 
midrange to that of median and mean in normal samples. E. 8. Pearson and 
H. O. Hartley [4] have tabled the values of the probability integral of range 
for sample size up to twenty. E. J. Gumbel [5], [6], [7] has established the inde- 
pendence of the extreme values in large samples from population of unlimited 
range and obtained the distributions of range and midrange. The asymptotic 
distribution of range has also been investigated by G. Elfving [8]. J. F. Daly [9] 
has devised a t-test adopting range in place of standard deviation in Student’s t 
and in a modified t-test E. Lord [10] has used range instead of standard devia- 
tion. An extension to two populations of an analogue of Student’s t-test using the 
sample range has been worked out by John E. Walsh [11]. 8. S. Wilks [12] has 
given a complete and detailed account of the researches on order statistics and 
also a number of suggestions regarding possibilities of utilising order statistics 
in statistical inference. In this paper the distribution of midrange has been 
developed as a series and a method of evaluating the probability integral for 
semi-range based on an infinite series expansion for the normal probability 
integral has been suggested. 


3. Distributions of midrange and semi-range. Let 


Ce ee 


be an ordered sample from a normal population with zero mean and unit stand- 
ard deviation. Then the joint distribution of x; and 2, , the lowest and highest 
values respectively, is given by [13], 

100 
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Zn n—-2 ii 
(1) P(X1, tn) = [n(n — 1)/2el| | ” aes ate | on ceiteay 2 


Let 

M = (a, + z,)/2 
and 

W = (a, — 2,)/2. 


M is the midrange and W is the semi-range of the sample. From (1) the simul- 
taneous distribution of VM and W reduces to 


M+W n-2 
(2) p(M, W) = [n(n — 1)/ale Ot?” | / eer at/ Ve | 
M 


= 


It has been shown [14] that if 


M+W ue 
(3) F(M, W) = | / e fr it) Vie | 
M—W 


(4) F(M, W) = penne + AM eines A® mM” ie sel 


k 
’ 


? 


where A” coefficient is given by 
2iAs = kA®, — ky/2/e[AS?W 
(5) (k—-1) qz773 (k—1) qy2i-1 . 
+ Aj-2 WwW /T(A4) + eee +Ao Ww /T(2z)]. 
Using expansion (4) equation (2) reduces to 


(6) p(M, W) = [n(n — 1)/ele Ot? SA M*, 
+=0 


It is evident that the A’s involve terms of the form 
low) ween 
where s, g, m are positive integers and 
w 
$(W) = ~/2/a | en Pl? at 
0 


Integrating (6) with respect to W 


(7) p(M) = [n(n — 1)/ale"™” > B;M" 
where 
(8) Bo = Vx/2I(n — 2, 0, 2), 


(9) Bi = [(n — 2)/2||Vx/2 I(n — 2, 0, 2) — I(n — 3, 1, 3)], 
By = [(n — 2)/2°T(3)|[Wx/2 (n — 2)I(n — 2, 0, 2) 
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(10) — (2n — 5)I(n — 3, 1,3) — (1/3)I(n — 3, 3, 3) 

+ V2/m (n — 3)I(n — 4, 2, 4)] 
where 
(11) I(2,¢,m) = VWFJs [ (x) Ix? eae, 


Using the method of integration by parts, the evaluation of J(s, q, m) can be 
reduced ultimately to that of J(p, 0, r) and this function for different values 
of p and r is given in Table I. 


TABLE I 
Values dud ra I(p, 0, ar 





. 
Pp moneeunes — — — seanona nemmens —— - — 
2 4 | 6 | 8 
0.277 ,063,21 0.147, 583, 62 | 0.100,735,97 | 0.076,490, 19 
0.152,980,4  0.064,094,20 | 0.037,255,93 | 0.025 ,060,53 


0.033 ,453 6 
0.019 ,535,1 


0.016 ,808,71 | 


0.008 ,589 , 57 


1 
2 
3 0.098 ,373 
4 0.069 , 10 
2 


0.051 ,44 0.012 ,325,5 
6 0 .039 ,90 0 .008 ,223 ,9 
7 0.031 ,94 
8 0.026 ,17 


The first five B Coefficients for n ranging from 3 to 10 are tabled below. 


TABLE II 
Values of B Coefficients. 





3 | 











Bo By | By | Bs | By 
3 0.347247 25.0. 040 ,642 (8710 002,772,900. 000 , 133, 8010. 000, 005 ,00 
4 0.191,732 0.058,751 (0.010,906 '0.001,460 0.000,153 
5 0.123,292 0.067184  0.021,526  0.004,988 (0.000 ,909 
6 '0.086,60 0.070,93 0.033,23 0.011,20 |0.002,97 
7 0.064,47 0.072,20 |0.045,65  0.020,28  0.007,14 
8 0.050,01 0.072,09  |0.057,22 (0.032,21 (0.014, 59 
9 0.040,03 0.071,27 0.068,95 0.047,01 |0.024,98 
10 0.032,80 0.069,97 —0.080,31 0.064, 66 0. 040,51 








1 The integrals have been evaluated by using (14). 


e 


DISTRIBUTION OF MIDRANGE 103 


The accuracy obtained by keeping the first five terms in p(M) may be judged 
from the following values of the total probability calculated for small values 
of n. 


TABLE III. 
Total probability keeping the first five terms in p(M) 
of sample | 3 | 4 5 | 6 | 7 
Total probability | 0.999 ,998 | 0.999 ,92 | 0.99956 | 0.998,8 | 0 .997,8 





Integrating (6) with respect to M, p(W) may be obtained. But p(W) in- 
volves integral ¢(W) and to evaluate the integral probability of W expansions 
for ¢(W) and its powers have to be developed. 


Since = g (W) = Vix | e°? dt = V/2/eW(l — W°/6+ --:), 


a convenient expansion is given by 


Ww . 

(12) 2/x | e? dt = VS]eWe' + aW + --- +aW* + --:) 
0 

where a; follows the recurrence relation 

(13) 3(2i + la; — axa = (—1)'/3° TH + 1), 


as may be seen by differentiating (12) with respect to W and equating the coeffi- 
cient of W™ on both sides. Again 


(14) [o(W)}? = (2/n)e "wis? 
where 
(15) S=1+aW'+aWwe+---+aW"+--- 
and 
(16) Si=14+ KPW4+ KP w+ --- 
where 
(17) Ki? = > 1C, stat! az? --- af*/si!se! --- 3;! 
and 
8: + 28 + --- + 18; = 1, 
(17a) 


S + Ste: '- + & =58. 


Clearly a; = K§”. In evaluating the Ks summation with respect to s is first 
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performed, the values of s; , s., --- , s; being obtained so as to satisfy the rela- 
tions (17a); and thereafter the values of the a’s are substituted. It may be noted 
that a, = 0. The K coefficients for 7 up to 8 and 7 up to 13 are given below, 


TABLE IV 
KY Coefficients. 








_— a $$$ Guanuieeamhadedam 
| 2 3 | 4 5 
1 | 0.011,111,11 —0.0°35,273,369 | 0.0'44,091,711 | —0.0517 814,833 
2 | 0.022,222,22 —0.0°70,546,737 | 0.0°21, 164,021 | —0.011,401 ,493 
3 | 0.033 ,333,33 —0.0710,582,011 | 0.0°50,264,550 | —0.0'28 ,860 ,029 
4 0.044,444,44 —0.0714,109,348 | 0.0°91,710,758 | —0.0454, 157,091 
5 0.055,555,56 —0.0°17 636 ,684 | 0.0714,550,265 | —0.0°87 ,292 ,680 
6 | 0.066,666,67 —0.0°21,164,021 | 0.0°21,164,021 | —0.0°12,826 ,680 
7 | 0.077,777,78 —0.0°24,691,358 | 0.0°29 012,346 | —0.0*17,707 ,944 


8 0.088 ,888,89 —0.0°28 ,218 ,695 | 0.0°38 ,095 ,238 | —0.0°23 ,373 ,061 


j Le ; oe _ ; inet s - 








6 7 | 8 9 

1 | 0.0510,087,459 —0.0°38,065,882 | 0.0°14,772,299 | —0.0"47,770,889 
2 | 0.0513,059,860 —0.0°78,306,957 | 0.0857 ,379,607 | —0.0° 32,240,604 
3 | 0.0°49,870,764 —0.0°35,414,321 | 0.0°37,246,865  —0.08 26,934,251 
4 0.012,515,888 —0.0°96,195,746 | 0.0°13,039,809 —0.07 10,793,811 
5 | 0.025 264,163 —0.0520,323,918 0.0°33,614,797 —0.07 30,234,979 
6 | 0.0'44,603,642 | —0.0536 960,883  0.0°72,070,037  —0.07 68,563,784 
7 0.0'71,905,926 —0.0560,836,892 | 0.0513,654,992 | —0.08 13,526 ,252 
8 0.0°10,854,319 —0 093,258,365  0.0°23,672,301  —0.0° 24,174,891 
j - ee ————— 

10 11 12 138 

1 | 0.0"14,640,444) —0. 040,268, =| 0.0'510,359,029 —0. 0724 , 535 ,539 
2 | 0.018 330,114) —0.0"91,351 ,579| 0.043 595,840, —0.0"19, 132,452 
3 | 0.09 21,506,514 —0.014 469,203 0.0296 661,910, —0.0%58 ,727 ,628 
4 | 0.08 10,849,591 —0.0"87,178,260) 0.0"72,767 557) —0.0"54,213,617 
5 | 0.08 36,260,639 —0.0° 32,719,538| 0.0"32,219,900 —0.0"27 ,049,719 
6 0.0595,092,297 —0.0° 93,120,388) 0.0° 10,472,881 —0.0"96 ,020,717 
7 | 0.07 21,247,442 —0.08 22,112,968 0.0° 27,825,332) —0.027 369,553 
8 | 0.07 42,365,199 —0.08 46,218,579 0.0" 64,147,144 — 0.066 862,484 
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Using (12) the probability integral for W can be evaluated with the help of 
tables of Incomplete Gamma Functions. 
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THE IMPOSSIBILITY OF CERTAIN SYMMETRICAL BALANCED 
INCOMPLETE BLOCK DESIGNS 


By 8S. 5S. SHRIKHANDE 
University of North Carolina 
Introduction and Summary. An arrangement of v varieties or treatments in 
b blocks of size k, (k < v), is known as a balanced incomplete block design if 


every variety occurs in r blocks and any two varieties occur together in X blocks, 
These parameters obviously satisfy the equations 


(1) bk = or 

(2) A(v — 1) = r(k — 1). 
Fisher [1] has also proved that the inequality 

(3) b>», r>k 


must hold. If v, b, r, k and \ are positive integers satisfying (1), (2) and (3), 
then a balanced incomplete block design with these parameters possibly exists, 
but the actual existence of a combinatorial solution is not ensured. These condi- 
tions are thus necessary but not sufficient for the existence of a design. Fisher 
and Yates in their tables [2] have listed all designs with r < 10 and given com- 
binatorial solutions, where known. A balanced incomplete block design in which 
b = v, and hence r = kK is called a symmetrical balanced incomplete block 
design. The impossibility of the symmetrical designs with parameters v = b = 22, 
r=k=7, = 2andv = b = 29,r = k = 8, A = 2 was first demonstrated 
by Hussain [3], [4] essentially by the method of enumeration. The object of the 
present note is to give an alternative simple proof of the impossibility of these 
designs and to show that the only unknown remaining symmetrical design in 
Fisher and Yates’ tables, viz.v = b = 46,r = k = 10, = 2, is definitely im- 
possible. Symmetrical designs with A < 5, r, k < 20, which are impossible 
combinatorially, are also listed. 


1. A necessary condition for the existence of a symmetrical balanced incom- 
plete block design when » is even. 

THEOREM 1. A necessary condition for the existence of a symmetrical balanced 
incomplete block design with parameters v, r and X, where v ts even, ts that r — i 
be a perfect square. 

Proor. Let N = (nj;;) be a square matrix of v rows and v columns where 


(4) nij = lorO 
according as the 7-th treatment does or does not occur in the j-th block. Put 


(5) B = NN’ 
106 





; in 
n if 


(3), 
ists, 
ndi- 
sher 
om- 
hich 
lock 

22, 
uted 
‘the 
hese 
n in 


sible 


Om- 


need 
— i 


here 


Put 
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Since every treatment occurs in r blocks and every pair of treatments in A 
blocks, we have, if the design is possible, 


r Xv A 
(6) —_ * A 
A A r 


Subtracting the first column from all the other columns and then adding to 
the first row all the other rows, we see that 


|B| = [r+ — 1)\(@r — a)" 
(7) 2 v-1 
= r(r—) from (2). 
But from (5) 
|B) =|N/. 





Since | N | is integral, it follows that (r — A)” is the square of an integer, and 
hence if v is even, r — must be a perfect square. 
Coro.uary. The following symmetrical designs are impossible. 


(A) vy = b = 22 r=k=7 A= 2 
(A2) v= b= 46 r=k=10 A= 2 
(A3) y= b = 92 r=k= 14 A=2 
(Aq) v= b = 106 r=k=15 A=2 
(As) v= b = 172 r=k=19 A=2 
(Ag) v=b= 34 r=k= 12 A = 4. 


As already mentioned in the introduction, the impossibility of (A,) has been 
proved by Hussain [3], but for the design (Az) it was hitherto unknown whether 
or not a solution is possible and it was left as a blank in the latest edition of 
Fisher and Yates’ tables. 


2. Application of method of Bruck and Ryser. 

In a recent paper Bruck and Ryser [5] have proved the impossibility of some 
finite projective planes with the help of the properties of matrices whose ele- 
ments are integers. Their method is immediately applicable to our own problem. 

Let A and B be two symmetric matrices of order n with elements in the ra- 
tional field. The matrices A and B are congruent, written A ~ B, provided 
there exists a nonsingular matric C with elements in the rational field, such that 
A = C’BC. The congruence of matrices satisfies the usual requirements of an 
“equals” relationship. 

If A is an integral symmetric matrix of order n and rank n, we can always 


construct an integral diagonal matrix D = (d,,--- ,d,), where d; ¥ 0,7 = 1, 
2,---n such that D ~ A. The number of negative terms 7, called the index 


of A, is an invariant by Sylvester’s Law. 
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Define d = (—1)'5 where 6 is the square-free positive part of | A |. Then since 
|B| =|C|?|A|, dis another invariant of A. 

Now let A be a nonsingular and symmetric integral matrix of order n. Let 
D, be the leading principal minor determinant of order r and suppose that 
D, ~ 0 for r = 1, 2,--- n. Define 


n—1 
(9) C,(A) = (~4, —Dn)» et (D;, _ D541)» 


for every odd prime p where (m, m’), is the Hilbert norm-residue symbol for 
arbitrary non-zero integers m and m’ and for every prime p. The following 
two theorems are given in the collected works of Hilbert [6]. 

THEOREM (A). Jf m and m’ are integers not divisible by the odd prime p, then 
(10) (m,m’), = +1 

(11) (m, P)p = (p, m)p = (m/p), 

where (m/p) is the Legendre symbol. Moreover, if m = m’ ¥ 0 mod p, then 


(12) (m, P)p = (m’, D)p. 

THEOREM (B). For arbitrary non-zero integers m, m', n, n’ and for every prime p, 
(13) (—m,m),p = +1 

(14) (m, n)p = (n, m)p 

(15) (mm’, n)p = (m, n)p(m’, n)» 

(16) (m, nn')p = (m, 2)p(m, n’)p . 

From the above it is easy to prove that for p an odd prime and every positive 
integer m, 

(17) (m,m + 1)p = (—1,m+ 1)p 


(18) I (j,9 + lp = (m+ 1)!, — 1),. 


We can now state the fundamental Minkowski-Hasse Theorem [7]. 

THEOREM (C). Let A and B be two integral symmetric matrices of order n and 
rank n. Suppose further that the leading principal minor determinants of A and B 
are different from zero. Then A ~ B <f and only if A and B have the same invari- 
ants i, d and C, for every odd prime p. 


3. A necessary condition for the existence of a symmetrical balanced in- 
complete block design for any integer v. 

Suppose the symmetrical design with parameters v, r and \ exists. Then 
with the previous definition of N and B, 

rN «rs JX 
‘ r ree 

B ” N1 : - . = ee F 
A A 
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Subtracting the last row from the remaining rows and then subtracting the last 
column from all the other columns, we get 
2r—-rA) (r—A)--: (r-A —(r-A) 
(r—A) Ar—A)--- (r-—A) — (r—-A) 
(19) cee cee cee : 
(r—dr) (r—dA) +++ AWr—A) — (r—A) 
— (r— A) — (r— A) ---—(r—-2d) r 
Obviously Q ~ B. But B ~ I. Hence Q ~ J and, therefore, since Q and J satisfy 
all the conditions of Theorem C, they must have the same invariants 7, d and C, . 
Let D; denote the leading principal minor determinant of Q of order 7. Then 


(20) D;=(r-—\A/*Gt forj = 1,2,---,9-1 
(21) and D, =|B\ =r(r—)*". 
Then, omitting p for convenience, 
0,(Q) = (=1, —D,)(Dea, ~Ds) TI (Dy, — Ds 
We use (10) --- , (18) in deriving the value of C,(Q). 
Now 
(-1, —D.)(Diu, — Dv) 
= (-1, —r(r — d)”")(r — A)”, —7’(r — d)”?) 
= (—1, —1)(—1, 7)(-1, & — )""M— 
(r — a)", —(r — d)”")0, FP), — (& -— )"”) 
= (-1, ( — \)"")Q@, — (r—d)"”) 
= (-1, (F — d)”™")@, —1)@, (@& — dy)". 
Also 


o—2 v—2 


I (D;, — Diz) = I ((r — 7G + D, — @ — NG + 2)) 


= e (ir — 5, -—(r- )G + 1, -G+ a} s 


=§ II (r — »)45, —(r — A)A(C(r — +), (7 —MG+t157+27G4+ 1, -D 
7 sl e-.. 6-0 +e-0944 -2 


= S(r —r, — °°?” (ww —1)!, — 1)(v!, —1) 
= S(r — », —1)° 9°", —1), 
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where 
s=TL@r—-»i 74+ 0r —»*,7 4D 
= TM - 4 74+9@-— 40 
= Mr - 5+ I - 7+ 2) 
= (r—,v)". 
”. C,(Q) = (r — A, —1)°°"” (vw, —1)*(r — a, v)”* 
(22) = (r—r, — 1°?" *(r — vd, vo)”. 


Hence we can enunciate the following theorem: 


THEOREM 2. A necessary condition for the existence of a symmetrical balanced 
incomplete block design with parameters v, r and d is that 


C,(Q) = (r _— A, —1)30-* (r a r, p23 a 41 


Pp 
for all odd prime p, where (m, n)» is the Hilbert norm-residue symbol. 
When »v is even we have seen that a necessary condition for the existence of 
the design is that r — \ be a perfect square. Then it is easily seen that 


C,(Q) = +1 
for all odd prime p. Therefore, even if the design is really non-existent, its im- 
possibility cannot be proved by this method. 
When, however, v is odd we can in many instances demonstrate the impossi- 
bility of the design. 
Consider the design 


(Az) v = b = 29, r=k=§8, A= 2 
C,(Q) = (6, —1)p (6, 29)) 
(3, 29) (2, 29)» 
(29/3) for p = 3 
(2/3) for p = 3 
= —] for p = 3. 


Hence the design (.17) is impossible. As mentioned in the introduction, the 
impossibility has already been demonstrated by Hussain [4] by a rather lengthy 
method amounting to a complete exhaustion of all possibilities. The following 
designs with \ < 5 and r, k <°20 can be similarly proved to be impossible by 
applying Theorem 2. 


(As ) y= b = 137 r=k= 17 A=2 
(Ag ) v=b = G7 p= k = 12 A=2 
(Ayo) yv,=6 = 103 rT = k = 1% A = 3 
(411) y = b = 53 rmak= 13 A=3 
(Ajo) v=b= 43 r=k=15 = 5 
(443) v=b= “i r= i = 20 h = 5. 


— UNS 
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My thanks are due to Professor R. C. Bose under whose guidance this re- 
search was carried out. 
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NOTES 
This section is devoted to brief research and expository articles and other short items, 
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THE SAMPLING DISTRIBUTION OF THE RATIO OF TWO RANGES 
FROM INDEPENDENT SAMPLES! 


RicuHarp F. Link 
University of Oregon 


Let us consider a sample of n ordered observations (x, < x2 < +--+ < aq) 
drawn from a population with variance o°. Let w = (t, — 21)/o. Let us consider 
the joint sampling distribution of w; and w. for two samples, not necessarily the 
same size, drawn from populations with the same variance. If the two samples 
were drawn independently, then the joint sampling distributions of w, and w, 
may be written as the product of the sampling distributions of w, and we . 

If we make the change of variable r = w,/we , w2 = w, and if w is integrated 
over its range of definition, the cumulative distribution of the ratio of two ranges 
remains. This may be written as 


(1) F(R) = [ dr [ dw-w-he(w)-hi(wr), 
0 


where h, is the pdf for w; and hz is the pdf for we . 

To obtain more explicit results, specific distribution functions may be consid- 
ered. The following table gives the sampling distribution of the ratio of two 
ranges from independent samples for the indicated density functions f(x). Notice 
that for the normal distribution it was possible to obtain results only for some 
special cases. 

In Table 1 for F(R), w; and we represent ranges computed from samples of 
size n, and nz respectively. 


Notice that formula (1) for F(R) is equivalent to the following expressions 
2 Rw2 
Pr(w;/w: < R) = F(R) = [dws [  aw.r(201) -r¢02). 
0 0 


The region of integration for the last expression is simply the region in the 
We , W; plane to the right of the line w; = Rw2. 

This integration was done numerically. Table 2 gives values of R for all com- 
binations of n; and n. < 10 and for a = .005, .01, .025, .05, .10 such that 


Pr(w;/w. < R) = a 
where w, and wz are ranges computed from samples of size n, and nz drawn from 
1 This work was done under contract N6onr-218/1v with the Office of Naval Research. 
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normal populations with the same variance. It is believed that these values are 
correct to within one place in the last reported figure. 

These tabled values may be used as critical values for testing the hypothesis 
that two independent samples were drawn from normal populations with the 
same variance. This test is therefore comparable to the F test. Some sort of 





TABLE 1 
f(z) F(R) = Pr (w;/w, < R) 
1 O0<z<1 a n1 (ny + Rin — 1) 
li 0 EE GE cnnccecirenn gy encom 
0 all other z no(nz — 1) Ee ‘n«% me 4m ~ 8 


4 R(ni — 1) 
| ni + ne 


9 z<0 | 1 —(ny— 1)(no — 1) . _ a (“>*) 


i=0 j=0 J 
es 1)*+7 
+7 ++2R)(114+2) 





2 2 
=< —-8 2 < a my = 2, no = 2 -tan!R 


ny = 2, no = 3 


Al 


tan7! ————— 
V4 + 3R? 


(ensineatmaaiineliniiy T 
(‘00 Vara? -§) 


Alo 


ny = 3, no = 2 


ni, = 3, ng =3 


R [ 2r {2 
| dr oe Go (u tan“! uw — v tan™! v) 
0 2s* | r* 


1 uy 
+ 0 +?) (w tan“! w — u tan™ u) + — tan“! 2ry 
“ rT 


6r°(1 + 7 J 
where 

u = [3(r? + 1) w = (7r? + 3) 

v = (4r? + 38) y = (3r? + 4)-3 


measure of the relative performance of these two tests seems desirable. An at- 
tempt to measure the performance of this test relative to the F test was made by 
comparing the tolerance intervals of the distribution of this ratio with those of 
the F test. 

The length of the interval containing the central 1 — 2a proportion of the 
distribution of F was compared with a similar length for the distribution of 
w,/w for ny = 22 = n. The square of the ratio of these lengths will be called .. 
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TABLE 2 
P( 2 < R) = .005 
We 























Pa 2 3 4 5 6 7 8 9 10 
2 | .0078 .0052 .0043 .0039 .0038 .0037 .0036 .0035 .0034 
3 096 .071 .059 .054 .051 .048 .045 .042 .041 
4 21 #16 ©6140. 182i s—(i SC 
5 | 30 .24 .22 #20 19 4.18 18 17 © 16 
6 38 32 28 2 2 24 238 22 ~ 22 
7 44 38 «4.34 4.82 4.380 29 28 27 ~~ © 2% 
s 49 43 «4.39 4.86 85 ©6838 @©=.82©0=)—.31-—S—iw 80 
9 54 47 1.43 1.40 4.88 87 4.86 86.35 .34 

10 57 ©6.50—'—i«i«wdGs—“‘<‘i‘ A‘ S*~*é‘«‘ A SC“‘<é‘é‘ SSCi‘ié‘ “SCSC*«GC*Z 
p(w < R) = 01 
We 
“a 2 3 4 5 6 7 8 9 1 

6 : 0 
2 | .0157 .0105 .0080 .0070 .0068 .0066 .0063 .0062 .0061 
3 | 136 .100 .084 .079 .073 .069 .065 .062 .060 
4 | 2 20 618 17 4.16 15 86.14 14 18 
5 | 38 30 26 24 23 22 21 21 20 
6 | 46 387 1.88 81 29 28 27 26 2% 
7 | 53 .43 1.89 14.86 84 #41838 82 ~@8©.81 .30 
gs |.59 .49 4.44 4.41 4.89 #42187 #486 #8 35 .34 
9 | 64 .53 48 4.45 4.48 .41 4.40 39 38 

10 | 68 57 52 49 46 45 43 42° 41 

Pr( 2 < R) = 025 
We 
—. 2 3 4 5 6 7 8 9 10 

2 ! 039 .026 .019 .018 .017  .016 .016 015 .015 
3 | 217 160 187 «9.124.115 «107.102.098.095 
4 | 87 2 2% 238 +4.21 20 19 18 .18 

5 | .50 .39 1.84 4.82 380 .28 27 26 .25 

6 | 60 47 4.42 38 36 84 838 8.382 31 

7 | .68 54 .48 .44 1.42 4.40 £4.88 £.87 ~~ «36 

8 |.74 59 1.53 49 4.46 44 43 42 Al 

9 | .79 64 87 53 .50 48 47 46 44 

10 | 


83 .68 61 ay | 04 02 .00 49 =.48 
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4 5 6 9 
.039 .036 .034 .032 .031 030 
.20 18 16 15 14 14 
32 .29 27 .26 .25 .24 
42 40 36 .30 33 .o2 
.00 .46 43 41 .40 .38 
oT .02 49 47 45 44 
.62 oT .o4 Ol .50 48 
.67 .61 .58 .0O 03 .O2 
.70 .65 .61 59 7 09 

pra < R) =. 
‘We 

4 5 6 7 8 9 

077 074 .069 .066 .062 .059 
.28 .20 .23 .22 21 .20 

42 .38 .36 34 .32 ol 
o3 .48 45 43 41 39 
.62 a6 .02 .00 .48 .46 
.69 .63 09 06 04 02 

1d .68 .64 61 .58 .06 
.80 13 .68 .65 .62 .60 
.85 17 72 .68 .66 .64 

TABLE 3 
Relative precision of the range as an 52 
estimate of o 
1.00 1.00 
.99 .99 
.98 .97 
.96 .95 
.93 .92 
91 .90 
.89 .89 
87 .88 
.86 
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For statistics having normal sampling distributions such a ratio would be in- 
dependent of a and would be equivalent to the ratio of the variances of these 
sampling distributions. It was found that 5% is independent of a except for a 
maximum change of 1 in the second decimal for the values of a = .005, .01, 
025, .05, .10. These values of 5° are presented in Table 3 along with the relative 
precision of the range as an estimate of o as given by Mosteller [1]. 

It is interesting to note that 5° corresponds very closely to the relative precision 
of the range as an estimate of co. 


REFERENCE 


{1] F. MostTe.ter, ‘‘On some useful ‘inefficient’ statistics,’? Annals of Math. Stat., Vol. 17 
(1946), pp. 377-408. 
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A NOTE ON THE ESTIMATION OF A DISTRIBUTION FUNCTION BY 
CONFIDENCE LIMITS 
By Frank J. Massry, JR. 
University of Oregon 
Let F(x) be the continuous cumulative distribution function of a random 
variable X, and let x; < x2 < 43 < --- <2, be the results of m independent 


observations on X arranged in order of size. We wish to estimate F(x) by means 
of the band S,(x) + /~/n where S,(x) is defined by 
S&S t2< em, 
S,(z) = k/nif x < 2% < Les, 


t O22 fe. 
Thus we wish to know the probability, say P,(A), that the band is such that 


r r 
S,(z) — a < F(x) < Sp(x) + wa for all x. This problem has been pre- 


viously studied [1] [2] [3] [4] [5] and a limiting distribution has been obtained 
[1] [4] [5] and tabled [3] [4]. However apparently no error terms for the limit- 
ing distribution, or practical methods of obtaining P,,(A) have been given. Such 
a method is given here. 

It has been shown [2] that P,(A) is independent of F(x) provided only that 
F(z) is continuous, and thus it is sufficient to consider only the case 


Oifz <0, 
F(e) =zf0O<z<1, 
lifzx>1. 


We will find the probability that S,(x) falls wholly in the band F(z) + k/n 
(here \ = k/+/n) where k is an integer or a rational number, and intermediate 
values may be obtained by interpolation. To illustrate the method we shall 
assume that / is an integer. 
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Divide the interval (0, 1) into n parts by the points 1/n, 2/n, --- , (n — 1)/n. 
The step function S,(x) rises by jumps of exactly 1/n. Thus, in order to be 
inside the band at x = i/n, S,(x) would have to pass through exactly one of the 
lattice points whose ordinates are (i — k + 1)/n, (t —k+2)/n,--- ,(i+k—1)/n. 

Suppose that the step function stays inside the band by means of a; of the 
observations falling in the interval c oe «7 = 1,2,---,n. The a priori 


probability of this happening is given by the multinomial law as 


! @1 a2 an 
Pay nes Qn) a ictal heise 1 1 eee ( 
ay! ao! +++ an! \n n n 


1 n! 


ai! +++ ana! n” 


since )o1 a; = n. 
Thus the probability of the step function staying in the band is given by 
n! ] n! 1 
P,(d) = i ae, ili TO 
(0) ee ern aa ee ! 
where the summation is over all possible combinations of a , --- , a, such that 


max | S,(x) — 2| < we and >, a; = n. 


i=1 
1 


in Cid = 2 


ay! +++ am!’ 


a= 1,2,--- ,2k — 1 be the sum of all the 


iat . ; . L—k ; 
terms indicated such that S,(zx) arrives at the lattice point (2 , - ten = = by 


a route that stays inside the band. Since the S,(x) is non-decreasing it can only 
pass through a point 


(met mobti +i), m= 0,1,---,n— 1]; j= 1,2,---, 2k —1, 


if it previously passed through one of the points 


(2 e+?) _ (2 mkt?) ad é mo bti+) 
n’ n “As” n 2." n ' 


If it passed through (2, nse) the value of am4: would have to be 


. T i 
(j + 1 — h) and the product U;(m) Gei- hy! Would be part of U;(m + 1). 
This is true for all h = 1, 2, --- ,7 + 1 and all of these terms would give dif- 
ferent paths for S,(x) so we have 
j+1 1 
U;(m ~ 1) = a G+1-—h)! 
where it is understood U;(m) = 0ifh > m+ k. 


U;,(m), j = 1,2,--- ,2k —1, 
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Thus we have a set of 2k — 1 linear homogeneous difference equations. They 
may be reduced to a single difference equation by eliminating 2k — 2 of the 
variables by substitution. This results in the following difference equation. 


2k—-1 ie h 
> (- 1 SD gyn — 1 — b+ m) =0. 
==] ° 


TABLE 1 
25 





o> 








.8624 : j .4808 
.9569 , ‘ .7016 
9892. .8471 
9979 . , d .9295 
9997 . .9708 


CSCONOoOhWWNH DY = 


|ooooocoouououns 





| 


55 60 65 70 75 80 





.2807 .2324 .1918 .1577 .1294 . 1060 
.9046 .4478 3954 .3492 .3072 .2696 
.6916 .6403 .9908 .0435 .4987 .4566 
.8234 1837 1434 4031 .6633 .6244 
.9063 .8789 .8496 .8189 1874 1004 


Initial conditions on either the simultaneous equations or on the single equa- 
tion are 


U,(0) = Ofori # k, 
U,(0) = 1 fori = k. 


. 
c 


After values of U;(n) have been found the value of P,, (Z) can be found by 


! 
multiplying U;.(n) by ~ 


The values of U;.(n) can be obtained numerically either from the simultaneous 
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equations or from the single equation. Table 1 was computed partly by numerical 
solution of the simultaneous equations above and partly by setting up similar 
equations connecting U;(x + 5) to U,(x), t = 1, 2, --- ,i + 5. Either method 
could be set up on punch cards if an extensive table was desired. Notice that 
to get Ux(n) all U;(t), t = 1, 2, --- ,m — 1 are also found. Table 1 gives some 
computed values of P,(k). Table 2 gives results interpolated from Table 1, 
showing the approach of P,,(A) to its limiting distribution. 


If the width of the band is 2 (*) when /: and / are integers a similar pro- 


cedure to that above can be used. However instead of dividing the interval 
(0, 1) into n parts it is necessary to divide it into l-n parts. 


TABLE 2 
1.0 


18 
17 
16 
16 
15 
15 
15 
74 
.607 .730 822 .888 .932 .960 


It has been suggested (2) that instead of a band bounded by y = x = ¢ it 
might be convenient to use a band bounded by the lines y = px + gq and 
y= p'x+q'.Ifp = p’ andif p, g, q’ are rational the probability of S,(x) staying 
inside the band can be evaluated by the method presented above. If p ¥ p’ 


and if p, p’, q, q’ are all rational a similar procedure could be used but it would 
be very tedious. 


[1] N. Smirnov, “‘Sur les écarts de la courbe de distribution empirique,’’ Recueil Math. 
de Moscou, Vol. 6 (1939), pp. 3-26. 

[2] A. Wap AND J. WoLFrow17z, ‘‘Confidence limits for continuous distribution functions,’’ 

Annals of Math. Stat., Vol. 10 (1939), pp. 105-118. 

[3] N. Smirnov, “‘On the estimation of the discrepancy between empirical curves of dis- 
tribution for two independent samples,’’ Bulletin Mathematique de l’Universite 
de Moscou, Vol. 2 (1939), fase. 2. 

[4] A. Kotmocorov, ‘‘Sulla determinazione empirica di una legge di distribuzione,”’ [st. 
Ital. att. Giorn. Vol. 4 (1933), p. 1-11. 

[5] W. Feuer, “On the Kolmogorov-Smirnov limit theorems for empirical distribution’* 
Annals of Math. Stat., Vol. 19 (1948), pp. 177-190. 
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SIGNIFICANCE LEVELS FOR A k-SAMPLE SLIPPAGE TEST! 


FREDERICK MOSTELLER AND JOHN W, TUKEY 


Harvard University and Princeton University 


1. Summary. Mosteller has recently [1, 1948] proposed a k-sample slippage 
test and has given percentage points for selected n, k and r for the case of k 
equal samples of size n. When the samples are of unequal size, exact significance 
levels can be calculated very quickly from 


o 
p, = 


WoO where x” = a(x — 1) --- (@9 —r+)D), 


by the method explained in section 3 below. 


The significance values for / equal samples of n > 10 are very well approxi- 
mated by 


1 eT (k-1)/2N 
kr- 


where N = kn. 
A convenient rough approximation for unequal samples may be given in 
terms of k*, an “effective”? number of samples, which is given by 


k* = (doi ni)” 


2 , 
ni 
the one-sided significance level will then be approximately given by 
P, = (Kyo, 


This approximation can be easily applied with the aid of Table 1. Thus, for 
example, with four samples of sizes 7, 5, 5, 2, we have 


pe — (7+5+5+4+ 2)" _ 361 
; 49+254+25+4 103 





= 3.50, 


whence from the table r = 3 lies at a one-sided level approximately between 
5% and 10%, r = 4 approximately between 1% and 2.5%, r = 5 between 0.5% 
and 1%, r = 6 near 0.2%, and so on. Direct calculation yields 5.7%, 1.2%, 0.2% 
and 0.03%. The approximation is, in this example, quite satisfactory for moder- 
ate significance levels and conservative for more extreme significance levels. 


2. Derivation. The statistic considered by Mosteller is the number of cases 
in one sample greater than all cases in all the k — 1 other samples. We derive 
its distribution briefly. 

Since the statistic depends only on the order of the n; + m2 + +--+ + 


1 Prepared in connection with research sponsored by the Office of Naval Research. 
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values, we can consider the actual values taken on to be fixed, and consider their 
allotment to the various samples. Assuming all of them to come from a single 
continuous distribution, we may consider these fixed values to be all distinct, 
and any way of allotting them to labelled places in the various samples as equally 
likely. 

Consider the r largest values. They can all be allotted to places in the i-th 
sample in ns? = n(n; — 1)--+ (nj — r + 1) ways, and to arbitrary places 
in N“” ways. Thus they will be allotted to some single sample in the fraction 


(r) 

N¢ 
p, = La 
N® 


of all cases. This is clearly the probability that Mosteller’s statistic is r or more. 


TABLE 1 
Approximate critical values of k* for various levels of significance 


One-sided | ; 
: — D 5% 5% 1% 0.5% 0.2% 
'wo-sided | 
level| 20° A 2% 1% 





= 100. 2 


Dwar Ss 
OO OHO 


CONT Cre W bO 


3. Unequal samples—an exact computation. Our practical problem is to 
compute P, for small values of r and a fixed set of n;. If we recognize the nu- 
merators as the unnormalized factorial moments of the distribution of sample 
sizes, we see that the computation goes smoothly according to the scheme shown 
in Table 2 (where the columns of multipliers n — 1, n — 2, — 3, etc. may be 
partially covered for convenience during the computation.): For example: 
132 = 11(12), 18320 = 10(132), --- 42 = 6(7). The numbers in the last line of 
Table 2 give successively the percentages 100 P; , 100 P2, --- . Of course P; = 
1 because some sample must have the largest value. It is clear that exact com- 
putation for any reasonable set of n; is quite easy. 


4. Equal samples—an approximation. In the case of k equal samples, we have 


kn” 
Pe = N° 


(r) 


Let us try to approximate to n” by expansion in powers. We have 
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n” =n(n —1)---(n—r+1) =n'(1 — 1/n)(1 — 2/n)--- (L-— (rF — 1)/n), 
so that 


r—] 

log n” = rlogn + >. log (1 — x/n) 
z=1 
r—] 


= rlogn — >> (2/n + 2°/2n? + 2°/3n’ ---) 


a=1 
= rlogn — r(r — 1)/2n — r(r — 1)(2r — 1)/12n" + O(n), 
TABLE 2 
Sample Computation 
for {n;} = (12, 11, 11, 11, 10, 10, 10, 10, 9, 9, 7, 4) 


nf n®f ; nf : 











| 

—_ | —_____ 
| 
| 


12 132 1320 
| 33 330 2970 
| 40 360 2880 
18 144 1008 
7 42 210 
4 12 24 





1020 8412 


114 12882 1442784 








100% 7.9% 0.58% 


and hence 
log P, = log k + log n” — log N” = log k + log n“” — log (nk)” 
= logk + rlogn — r(r — 1)/2n — r(r — 1)(2r — 1)/12n° 
— rlog nk + r(r — 1)/2nk + r(r — 1)(2r — 1)/12n7k? + O(n~’) 
r(r — 1) i, @=-1 9-1 —2 
a ie ee el Fe, ae a 
lata 2n ¢ kt 6n 6nk? oo ) 


We get the following three approximations: 


(1) Ra 


"gt? 


ik  k-V_ 


i aa 
and noting that ——— 
— n kn 


> 2 R-OH-D | Gr (r—1I)kK—-D)/2N | -. is 
P, = k e es [ker &—D) i2N}r—1 ? 
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and finally 


° —(r—1 —r(r—1) (k—1) /2N) (1+-(27r—1) /6n) 
(3) Rage, )(k—1)/ )U+(r—1)/6n) 


uv 


5. Comparison of results. The results obtained with various equal sample 
approximations will be compared with the exact values for several cases. The 
effective number of samples, /:*, used with (1), (2), and (3), is computed from 


k* = (dons)’ 
uv — 2 > 
Ni 
a formula which is often an easy and effective way to allow for different sizes of 
samples. 


TABLE 3 
Comparison of Approximations 
| | ; | 
Sizes of Samples | N | r | 





exact 





10, 10, 10, 10 | 4. | 23.08 
| 4.85 
3.50+ 2 | 


i, 2, 8, 


10, 10, 10, 10 | 114) 11.46 2. 


9 7, 4) | 3| 0.5 58 0.56 | <0.78 


A fourth approximation, which always gives a conservative estimate of the 
significance of the result is obtained by replacing n“ by n" throughout, this gives 


(4) P, — Zonk 
which is equivalent to approximation (1) when the samples are of equal size, or 
when r = 2. 

The results are shown in Table 3. 

Thus it seems clear that either (1) or (4) are good enough for rough work. 
The choice will depend on which formula one prefers to remember. The amount 
of work is about the same for either method. When something better is required 
the exact method of section 3 seems appropriate. Indeed some may prefer it to 
any approximation. 


REFERENCE 


{1] FrepErick MosTEL.er, “‘A k-sample slippage test for an extreme population,” Annals 
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ADJUSTMENT OF AN INVERSE MATRIX CORRESPONDING TO A 
CHANGE IN ONE ELEMENT OF A GIVEN MATRIX 


By JACK SHERMAN AND WINIFRED J. MORRISON 
The Texas Company Research Laboratories, Beacon, New York 


1. Introduction. Many methods have been published in recent years for carry- 
ing out the numerical computation of the inverse of a matrix [1], [2]. In all these 
methods, the amount of computation increases rapidly with increase in order 
of the matrix. 

The utility of a computational method for obtaining the inverse of a matrix 
would be increased considerably if the inverse could be transformed in a simple 
manner, corresponding to some specified change in the original matrix, thus 
eliminating the necessity of computing the new inverse from the beginning. 
The problem that is considered in the present paper is one of changing one ele- 
ment in the original matrix, and of computing the resulting changes in the 
elements of the new inverse directly from those of the old inverse. 


2. Computational method. Let 

ai;,%7 = 1,2,---,n,7 = 1, 2,--- , n denote the elements of an nth order 
square matrix a; 

b;; , denote the elements of b, the inverse of a; 

A,; ,denote the elements of A which differs from a only in one element, say Ars; 

B;; , denote the elements of B, the inverse A. 

Let 


Ars = Ors + Adgs. 


The set of equations by means of which B may be computed from Aags 
and b is 


bre bs; A ars 
1 + bse AGrs : 


(1) B,; = by; — 


provided that 1 + bsrAars ~ 0. 
The validity of equation (1) may be demonstrated by multiplying through 
by Ai, (r = 1, 2,--- , ») and adding the results: 


z. A ir B,; — _ A ir b,; — a 2 — 7 A ir ber ’ 

(2) = = 1 + bsr AQrs 7=1 
(§ = 1,2,--- , m3 7 = 1,2, «++ ,n). 
Consider separately the equations for which 7 # R, and for which 7 = R. 
Case I. i # R. By hypothesis, A;, = a;, for? # R. Henceequations (2) become 

. . bs; A Qrs 

Ai, B,; = ir b,3 — ————— 
(3) 2d . 2d seins 1 + bse A dps 7=1 
(i = 1,2, ---, 8-1, 8+1, -++, 953 


n 


Air bre, 





ADJUSTMENT OF AN INVERSE MATRIX 
The last sum vanishes because a and b are inverse matrices, and hence 


(4) » A ir B,; — dX Qir b; 
@=1,2,---,R-—1,8 + 1, --- ,n;j 
Case II. i = R. Equation (2) becomes 


= _ bs; A Gers ~ ‘ 
r Anise tbls ~ oe F Ak = 1,2,---,n). 
(5) a ” : 2 en 1 + dsr A dps 2d rr Dr G m = 


In each of the summations, there will be a term for which r = S, in which 


case Ars = Azs + Ads . Inall other cases, Ar, = ap, . Hence (5) can be written as 


Zz. A Rr B,; =— Zz. Arr by; + A Ars bs; 
r=] r=] 


(6) 
(ptt \(P ouba + daub) G= 13, 
(; + bsr A Ars 2d rr brn + 3 Crs bsp (J ois 1, 2, + n). 


r=1 


Since a and b are inverse matrices, the second summation on the right-hand 
side of (6) is equal to unity, and hence (6) becomes 


(7) 2, Agr Bry = 2D er br (j = 1,2, +++ ,n). 


The sets of equations (4) and (7) can be written as one set of equations: 
(8) D Air Br — Dd air by; (a — 1, 2, a n;j = 1, 2, le n), 
r=1 r=1 
and hence B is the inverse of A. 


3. Illustrative numerical example. In actual applications, equations (1) are 
conveniently subdivided into three groups, namely, those for which r = S, 
those for which 7 = R, and all others. In the first two cases, these reduce to 


bs; 


. Bt TE tee Dae’ 


(j = 1,2,---,n), 
(10) iii epee, (r = 1,2, --+,n). 
1 + bsz A zs 
By utilizing (10), (1) becomes 
B,; = br; — BrrbsjAars , 
(11) (7 =1,2,---,S—1,S+1,---,n; 
j3=1,2,---,R-—1,R+4+1,---,7n). 


_ Equations (10) and (11) show that the elements of B contained in the Sth 
row and Rth column are directly proportional to the corresponding elements of b. 
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Consider 

1.238 

Lis 

0.643 

3.087 

The inverse of b turns out to be 
0.2220 2.0210 —(0.1012 —1.4145 

ia —0.04806 —0.2918 —().1999 0.7079 
—(0.1692 0.01195 0.3656 —0.01824 

0.2801 —2.3517 0.07209 1.0409 


Assume that az is increased by 0.4, so that 


2.384 1.238 .861 
0.648 1.113 .761 
1.119 0.643 3.172 
0.745 2.137 . 268 


Then (9), (10), and (11) become 


bs; 
1 — 2.3517 X 0.4 
By = 16.857 bro (r _ 1, 2, ee ,n), 
ih, ~ Oe Rdie& « 1% ---, 8 = 1,841, --- a 


j=1,2,---,R-1,8+1,:- 


By = = 16.857 ba; 


Utilization of these equations gives 


—4.5518 42.608 — 1.3298 —19.155 
0.5031 — 4.9191 —0.05805 2.7560 
—0.1919 0.2014 0.3598 — 0.1021] 
4.7218 — 39.644 1.2153 17.547 


4. Concluding remarks. It is seen from equation (1) that if Aags = —1/Dsr, 
that is, if aes is increased by the negative of the reciprocal of the corresponding 
element in the transposed reciprocal matrix, then the denominator in the second 
term on the right-hand side of equation (1) becomes equal to zero, and B cannot 
be found by the present method. It is left to the reader to verify that under 
these conditions A is in fact singular. 

In the illustrative numerical example, the denominator is only 1 — 2.3517 X 
0.4 = 0.05932, which accounts for the large magnitude of some of the elements 
of B. If Aaa were taken to be 1/2.3517 = 0.4252 instead of 0.4, A would have 
become singular. 

If two or more elements in the matrix a are to be changed, the new inverse can 
be found by successive applications of the method. 
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A CLASS OF RANDOM VARIABLES WITH DISCRETE DISTRIBUTIONS 


ALBERT NOACK 


Cologne, Germany 


1. General results. A large class of random variables with discrete probability 
distributions can be derived from certain power series. Let 


f(z) = Do azz, azreal, |z| <r. 
z=0 


We may have either non-negative coefficients a, or we may have (—1)*a, > 0. 
In the first case take 0 < z < r; and in thesecond casetake —r < z < 0. Define 
a random variable with the distribution 


(1) Pig = 2} = Fe 


The above conditions insure P{t = x} => 0 for all x; besides 
1 
P{t = 2 a,¢ = 1. 
EPe= 3-4 


The distribution of § may be called the power series distribution (p.s.d.). 
The mean of such a distribution is 


E(é) = 2d «P| {¢ = z} = > za, 2" 


f op 
Hence it follows that 


(2) E(é) = TS =% . log f(z). 


We have for the moments about the origin 


= La Pit = 2} = = 


Tr z 
£ Gf, 


its ) 4 
and hence 


_f (az) 1 
*t2) J@4 


r z 
vt azzZ. 
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Thus we have the recurrence relation 


/ 
.. 


- , Se 
(3) Mryi = 2 + Mibr . 
The central moments are 


a” (x — wi) P{é = x} = — Do (x — wy)" a2", 


f ia 2 
and hence 
Set ne ‘yr z dur os _ | x 
2 Ser = =r Dd «(a — yi)’az2* — ar dz ja Do (x — wi)” az2 
he (z) 1 _ fy ai 
* (2) f@ 4 2 (x M1) a,Z. 
The sum of the first and third term will be found to be u,+; , hence 


du, du 
.—- = i we a 
dz Mr+ dz Mr 1 ’ 


whence we have for the central moments of a p.s.d. the recurrence relation 


du, d 
(4) Bry = -| % +r ‘= ‘ue. 


Putting r = 1, wo = 1, u, = 0, we get the variance of 


: - Xt) = a . = 2f"@_ 152) f'(2) 
(5) m= o(€) =2 iE m2 log f(z) + Mi a f@) +2 2 Fe) 





By (5), (4) assumes the form 
, in. 
(4 ) Mr+l = 2 = + Tyo M1 - 
The characteristic function of é is 
= Le Pte = 2} = Dae es 
or 


(6) ee 


To get a relation connecting the cumulants x, and the moments u; about the 
origin, we differentiate both sides of the identity 


> = (it) = log Do ™ (x? 
r=1 1. p=0 Pp; 
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with respect to (2d), identifying coefficients in (it)’”’ we get’ 
—/r—1 
w= O(5o 1) aw. 
J=1 Z ae 1 


Differentiation of (7) with respect to z gives 


- du, _efr-1 du,—; ’ fs] 
7) tiem (1 a + ot I, 


Substitution of (7) and (7’) in (3) gives 


rt+1 r ’ 
r ’ iii r—l dr; FP ’ dk; 
2, ( = 1) Mr+i—j kj = 2, t a ') 1E de + m1 us| Kj + &Mr—j dz > 


or by (3) after a little re-arrangement 


.fr—] 1 dk; —/r ] ' 
(8) Kr = 2 z ( — ') Mr—j : 72 ) > [ ) Mr+1—j Kj - 


j=1 j=2 « 


2. Special cases. 
(a) Choosing f(z) = e’, — has Poisson-distribution 


z 


(1a) Plt =x} = 


(2) and (5) are the well known relations E(£) = o°(£) = z; the recurrence formula 
(4) assumes the form? 


ly, 
(4a) Mr41 = @ BE + ras 


(b) Taking f(z) = (1 — z)“,k > 0,0 < z < 1 we get the so-called negative 
binomial distribution 


(1b) Pié aa x} - ae (1 a 2)"; = 0, 1, 2, aan 


The mean is 


E® = = 


’ 


Z 


while the recurrence formula for the central moments is 


1 rk 
4h asp 1 ss 
- roe ae ‘| 


hence the first three moments of this distribution are 


o(€) = ps 


'Cf. M. G. Kenpauu, The Advanced Theory of Statistics, Vol. I, p. 87. 
2 Cf. Craic, Am. Math. Soc. Bull., Vol. 40 (1934), p. 262. 
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“ k2(1 + 2) 
b « — ——— 
(5 ) 3 (i ee z)3 ? 
= ka(1 + 4¢ + 2 + 3kz) 
M4 (i os 2)! . 
The characteristic function of the distribution is 
it —k 
(6b) g(t) = C= : ‘) 
1—2z 


Writing z = n/(1 + ),k = h/n,n >0,h > 0 we get the so-called Polya-Eg. 
genberger distribution for rare contagious events . 


r (’ + r) « 
(1b) wflt = 2} = —1—_/ (3 ) (1 +9)", x= 0,1,2,--- 


x!V(hn") \i+n 
The first four moments of this distribution are 
(2b,) wi = h 
(5by) we = h(1 + 7) 
ws = h(1 + n)(1 + 27) 
wa = A(1 + n)[1 + 3(1 + n)(h + 27)). 


To obtain a recurrence relation for the moments consider 


du, es Ou, dn Our dh i (i + n) Es 4 h an | 


dz  @ndz oh dz dn | 7 Oh 

















hence we find for this distribution by (4) and (4b) 
Our » + rhs |. 
on 


an +h 








(4b:) Broil = (1 + n) E 


It follows from (4b,), that yu, is a polynomial in » and h. The characteristic fune- 
tion of this distribution is 


(6b:) g(t) = [1 + n(1 — ey”. 


(c) The coefficients of the series —log(1 — z) = > 21 2 /x are positive; the 
associated distribution derived is 


ar 
a 


(1c) Pi§é =z} = G<ce<t hk «212°, 


~~ g log (1 — 2) 
and has the mean 


le a6: ia: catceeelileeaianneres 
~ Ee) (1 — z) log (1 — 2) 


3 Cf. Zeits. f. angew. Math. und Mech., Vol. 3 (1923), p. 279-289. 


Fune- 


; the 
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Recurrence formula (4) has for this distribution the form 


— 2+ log (1 — 2) | 


r - 
dz (1 — z)flog (1 — 22" 
while the variance and the characteristic function of this distribution are 


(5e) aw tn 12s - 2 


~ (1 = 2)flog (1 — 2)’ 


(6c) tilt we log (1 — e*‘z) 


log (1 — 2) 











(4c) Mri = 











(d) The coefficients of the series log (1 + z)/(1 — z) = 2 > (277) /(2a+ 1) 
z=1 


are positive, so we can derive a random variable ~ with the distribution 


9 fet! 

ih Pie 41} - ——=........., 
Z 0 l.xr=1,.2 eee 

(22 + 1) log 2 <2< 1,2 , 2, 3, 


¢ has the mean 








22 
(2d) ™* files hia ss +2 
the recurrence formula (4) assumes the form 
aie (1+ 2) logy 3 — 22 
(4d) Mroi = 2 > + 2r - 1 - ap Mr |> 
(1 — £){ log = | 


while the variance and the characteristic function of & are 


1+2 





(1+ 2) log j — — 2 
(5d) o(é) = 2z sinntoms oct . 
(1— ¢) ie 1+ a 
l1—2 
. log (1 + e*'z) — log (1 — ez) 
” Oo "ates 
(e) Likewise the coefficients of the series 


7" 1-3-5---(2x — 1) "Sai 
calla oS 2:4-6---(2t) In +1 


are positive, the derived variable ~ with the distribution 


Pig = 1} = (sin 2)", 
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1-3- . (2x _ 1) ” ida | nail 
Plt = 27 ij = . s Zz 
Oe eh Sa. Sei? 
O<z<17=1,2,3,--. 
has the mean 


2 


(2e) E(t) = a = — 


—-2 sin 


a 
The recurrence formula for the moments 


lu, sin z — - 2vV1 —-2 
4e) = 5 +7 sins - - 
( — dz ; ne 2?°(sin” a e 


gives the variance 
=§ 
2 in 2 — ei 1— 
(5e) (@) «<> a 
rw — 2°(sin~ ay 


The characteristic function assumes the form 
—1l 
sine 2 
(6e) gi) = —— ; 
~~ 


(f) It is well known, that series a a (c), (d), and (e) are special cases of the 
hypergeometric function F(a, b, c; z). This function gives a p.s.d., if abe > 0. 
Ifa > 0,b >0,c > Oorifa < 0,b < 0,¢ > 0, a, b integers, there exist no 
further restrictions on these parameters. Suppose a < 0, b < 0,c¢ > 0, a integer, 
b not, we must have [b] < a‘; if neither a nor b are integers, we must have 
[a] = [b]. Suppose a < 0, b > 0,¢ < 0. If c is an integer, a must be an integer 
> c. If a is an integer, but ¢c not, we must have [c] < a. Finally if neither a 
nor c are integers, we must have [a] = |c]. Corresponding conditions are valid, 
ifa>0,b <0, c < 0. Regarding 

ab 


£ Fay; ¢;2) = 3 F(ia+ 1,b+ 1l;¢ + 1;2), 
dz , 


the mean of a random variable — with hypergeometric distribution is 


(21) E(t) = _ab F(a + 1, b+ 1; e+ Iz) 


é oaieaaessananssten 


c F(a, b; c; 2) 
Considering the differential equation 
2(1 — z)f"(z) + le — (a+b + I)zlf(z) — abf(z) = 


(5) gives the variance of & 


2, _ ab 2 f Fa+1,b+1,¢+ 1,2) 
(58) ne tage ee ee ee icicca 
5 — ott ~ | Plt aay 
- ~ ¢ F(a, b;¢; 


The higher n moments of this distribution can now derived from (4’). 


4 [b] means as usual the greatest integer <b. 
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THE GEOMETRIC RANGE FOR DISTRIBUTIONS OF CAUCHY’S TYPE 


By E. J. GumMBEL anp R. D. KEENEY 


New York City and Metropolitan Life Insurance Company 


1. Introduction. We consider large samples drawn from a symmetrical un- 


limited population whose distribution is of the Cauchy type, defined by the 
properties 


(1) lim a'[1 — F(x)] = A, lim (—2)‘F(x) = A, 


where k and A are positive and F(x) stands for the probability function. This 
type of distribution has no moments of an order equal to or greater than k. 
We construct the distribution of a certain function of the extreme values, and 
require only the knowledge of the type of the initial distribution, not of the 
distribution itself. 

From each sample we pick out the largest and smallest observations, x, and 
a, . If the median of the initial distribution is zero, and the sample size is large 
enough, the probability of any extreme x, or —2, being negative can be neglected. 
If we draw N such samples, each of large size n, we obtain N pairs of extremes, 


Yn,» and m,, (v = 1, 2,3, --- , N). For each sample we can then compute the 
geometric mean, p, of these extremes: 
(2) -S V tn(— x1), 


which we henceforth call the geometric range. 

The distribution of these geometric ranges can be obtained directly from the 
joint asymptotic distribution of the extremes. However, it is easier to obtain 
this distribution indirectly from the distribution of the reciprocal of the geometric 
range. This distribution of the reciprocal is of interest in itself: since it possesses 
all moments we can use it to estimate the parameters by the method of moments, 
whereas this problem seems to be very intricate if we start from the distribution 
of the geometric range itself. 


2. The distribution of the reciprocal of the geometric range. The distribu- 
tion of the reciprocal of the geometric range follows from a theorem of Elfving 
(1) which may be stated thus: 

“Let x be a symmetrical unlimited variate with probability F(x). Let & be 
defined by 


(3) £ = 2n VF(2)[1 — F(a). 


Then the asymptotic density function g(£) and the asymptotic probability G(é) 
of — are: 


(4) g(é) = EKo(é);  G(é) = 1 — EA, (E), 


where Ky and K, are the modified Bessel functions of the second kind and of 
order zero and one.” 
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Introducing instead of A the parameter u defined by F(u) = 1 — 1/n we 
have, from (1), approximately for large n 


k I: 
(5) F(a) = 1/n (.), 1 — F(a.) = U/nf ), t1 < 0,%, >0,k >0, 


u 

Ln 
For the variable é in Elfving’s theorem, we obtain asymptotically 
(6) £./2 = u‘p “. 


We attach a subscript /: to — to show its dependence on k. The moments of & are 
obtained from a formula given by Watson ((3], p. 388) as 


ee 


(7) te = 2'T’°(1 + 1/2) 


and all moments of this variate exist. 


3. Estimate of parameters. From WN sets, each of n observations, we pick out 
the largest and the smallest, X,,, and X,,,. We subtract from each observed 
extreme the central value, m, of the N -n observations. If eachz,,, = X,,.—m >0 
and 2),, = X;,,—m < 0 the sample size is large enough. 

Define 7 = 1/p. The first two moments of n are, from (7), 


(8) i= : r’(1 + 1/2k), 2 = Sr + 1/k). 


Elimination of the parameter u from these two equations leads to 
 _ T(1 + 1/k) 
2 -T41 + 1/2k)y 
In terms of the coefficient of variation, V, this equation becomes 
(9) V1 + V? = Tl + 1/k)/T°(1 + 1/2k). 


Substituting the value of V computed from the observations, we obtain an es- 
timate of k, and hence can obtain an estimate of u from (8). This procedure is 
facilitated by Table 1. 

4. The distribution of the geometric range. From a practical standpoint 
the geometric range itself is preferable to its reciprocal since it is easier to interpret 
and easier to calculate from the observed extremes. We want to establish its 
distribution g;(p). From the relation (6) of p to & and the knowledge of the dis- 
tribution (4) of & we find 


(10) Gi(p) = 1 — G(&) = 2u‘p “K,(2u‘p “) 


and 


2. ku* ., 4k fu\** _ (Qué 
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>0 
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Since tables of these Bessel functions are available [2], the various probabilities 
and densities may be evaluated. 

The simplest way to compare geometric ranges to the theory is the use of a 
probability paper (Figure 1). For its construction, consider the linear relation 


(12) log p = log u + (log 2)/k — (log &)/k 


obtained from (6). Consequently we plot —log & on the abcissa and write the 
corresponding values G;(p), formula (10), on a horizontal axis. An upper parallel 
to the abscissa shows the return periods. The observed geometric ranges are 
plotted on the ordinate in a logarithmic scale. If the theory holds, the observed 
geometric ranges should be scattered about the straight line (12). 


TABLE 1 
The order k and the variation V of the reciprocal of the geometric range 


Reciprocal Order Coefficient of Reciprocal Order Coefficient of 


variation variation 
We F 1/k y 
.10 .088 | .70 | 006 
.12 104 .80 | .632 
.16 .138 .90 .709 
.20 171 .98 4d 
.30 .201 1.00 .788 
40 .332 2 .00 1.73 
.00 .404 4.00 5 .92 
.60 .480 6 .00 20.0 





If less accurate estimates of u and k than those obtainable by the systematic 
methods (8) and (9), or the probability paper, will suffice, quick estimates can be 
obtained from the quantiles of the sample of geometric ranges. To the value 
p = u corresponds, according to (6), &, = 2 whence, from the tables [2], Gi(w) = 
2K,(2) = .27973. From N observed geometric ranges arranged in increasing 
magnitude we thus may pick out the mth, p» , with the rank m .28 N and 
use it as an estimate uw = p,» . For the medians & and p we get & = 1.257 from 
the tables, and thus, by (6), p° = 1.591 u*. This formula provides a quick estimate 
of k. We pick out the median p of the N observed geometric ranges. Since we 
have an estimate of u, we obtain an estimate of k from 


(13) 1 log p — log u 


:*"e [5/pml - 


5. Analogy between the geometric range and the range. A study of the various 
characteristics of the geometric range for distributions of Cauchy’s type reveals 
structural similarities to the range for distributions of the exponential type. 
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This is not altogether surprising, since (as shown in Table 2) after the appropri- 
ate transformations the probabilities of both are identical functions of the respec- 
tive transformed variates. 

Of course the two systems are mutually exclusive: if the observed ranges can 
be reproduced by the first system we conclude that all moments in the initial 
distribution exist. If on the other hand, the observed geometric ranges can be 


represented by the second sytem we conclude that no moments of an order 
greater than k exist. 


TABLE 2 
RANGES AND GEOMETRIC RANGES 


Distribution Exponential 





Type of Initial | | Gauchy 
Variate | Range Geometric Range 
Definition | w= an + (— 2) p= V2 (— 21) 
Transforma- [ & = Qué p-* 

tion 


| 
z = 2exp | — 5 en — 21 - 2 | 


| 
; a k 
Logarithm Igz=lg2-— > (rn — 21 — Qu) Ig& =Ig2— 3 (lg zn 


+ Ilg(-— 2) - 2 Ig'u) 


Probability G(w) = z K, (2) Gi (p) = & Ki (&) 


z2 4k ok+1 
Distribution g(w) = Ko (2) gi (p) = — > Ko (&) 
2 u\2 
Median W = 2u + .9286/a 2lg p= 2lgu + .9286/k 
Mean ® = 2u+ 2y/a Ig po = — Igu+2lgI(1 + 4k) 
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REMARK ON W. M. KINCAID’S “NOTE ON THE ERROR IN 
INTERPOLATION OF A FUNCTION OF TWO 
INDEPENDENT VARIABLES” 


By T. N. E. GrevILLe 
Federal Security Agency 


In a review of Dr. W. M. Kincaid’s ‘Note on the Error in Interpolation of a 
Function of Two Independent Variables,” (Annals of Math. Stat., Vol. 19 (1948), 
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pp. 85-88) which appeared in Mathematical Reviews, Vol. 9 (1948), p. 470, I 
stated that ‘“‘a more simple and elegant, and equally general, expression is ob- 
tainable by a simple adaptation of formula (41), p. 215, of J. F. Steffensen’s 
book, Interpolation.” 

This statement is not entirely correct and is also misleading in its implications 
since Dr. Kinecaid’s expressions are actually more general in certain respects, and 
simplicity and generality are not the only considerations nor, in this case, the 
most important ones. In setting up an expression for the remainder in an inter- 
polation formula, the primary objective is to secure an efficient appraisal of the 
remainder. In this respect, Dr. Kincaid’s expressions are superior as they involve 
only the higher derivatives of the function it is desired to represent, whereas 
Steffensen’s method would always involve a first derivative term in such a way 
as to prevent any refinement of estimates of the error by introducing additional 
given values. 

ee 


REMARK ON MY PAPER “ON A THEOREM OF HSU AND ROBBINS” 
By P. Erpés 
Syracuse University 


Professor Robbins kindly pointed out that in my paper mentioned in the title 
(Annals of Math. Stat., Vol. 20 (1949), p. 286-291) I have misquoted a statement 
in the paper of Hsu and Robbins (‘‘Complete Convergence and the Law of 
Large Numbers” Proc. Nat. Acad. of Sci., Vol. 33 (1947), p. 25-31). I attribute 


to Hsu and Robbins the conjecture (notations of my paper) that if )) M, < « 


n=1 
then (1) and (2) hold, and proceed to give a counter example. However, the 
conjecture of Hsu and Robbins is not the above false one but the following: If 
pa M, < ~ and (1) holds then (2) also holds. This conjecture is true and is in 


n=l 
fact proved in my paper. 

Professor Robbins also points out that a slight modification of my theorem 
can be stated in a more concise form as follows: Let X; , X2 , --- be a sequence of 
independent random variables having the same distribution function F (x), and let 


Vs a (1/n) (X + uae + Xn) 


Then the necessary and sufficient condition that 


2, PALY.i > el < @, for every « > 0, 


is that 


0, | a dF(x) < @. 
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ABSTRACTS OF PAPERS 


(Abstracts of papers presented at the New York meeting of the Institute, 
December 27-30, 1949) 


1. The Asymptotic Distribution of the Extremal Quotient. E. J. Gumpe., New 
York, anD R. D. Keeney, Metropolitan Life Insurance Company, New York. 


The extremal] quotient is the ratio of the largest to the absolute value of the smallest 
observation. Its analytical properties for symmetrical, continuous and unlimited distribu- 
tions are obtained from a study of the auto-quotient defined as the ratio of two non-nega- 
tive variates with identical distributions. The relation of the two statistics is established 
by proving that, for sufficiently large samples from an initial distribution with median 
zero, the largest (or smallest) value may be assumed to be positive (or negative) and that 
the extremes are independent. The logarithm of the extremal quotient has asymptotically 
a symmetrical distribution. Its median is unity. As many moments exist for the extremal 
quotient as moments and reciprocal moments exist simultaneously for the initial variate. 
For the exponential type of initial distributions, the asymptotic distribution of the ex- 
tremal quotient can only be expressed by a complicated integral which may be approxi- 
mated in the interval } < q < 2 by the logarithmically transformed normal probability 
function. In this case, no moments exist. For the Cauchy type, the asymptotic distribution 
of the extremal quotient is very simple. The logarithm of the extremal quotient has the 
same (logistic) distribution as the midrange for initial distributions of exponential type. 
For both initial types, the asymptotic distributions of the extremal quotients possess one 
parameter which may be estimated from the observations. 


2. A Second Formula for Partial Sums of Hypergeometric Series having the 
Unit as Fourth Argument. HERMANN VON SCHELLING, Naval Medical Re- 
search Laboratory, U. 8. Submarine Base, New London, Conn. 


If the arguments a and 8 are changed after the summation, published Ann. Math. Stat. 
Vol. 20, (1949) p. 120, and this method is applied 4 second time, a new formula results for 
partial sums of F(a,8,7;1). A simple recurrence formula is developed for these partial 
sums. The new equation is a numerical short cut as it is demonstrated with an example. 


3. A Coverage Distribution. Herspert Sotomon, Office of Naval Research, 
Washington, D. C. 


Consider a fixed target circle of radius Tz and center at a distance R from an aiming 
point. Let N circles each of radius Wr be dropped at the aiming point with their centers 
subject to a bivariate normal distribution with circular symmetry, the common standard 
deviation denoted by c. Define y as the set theoretical sum of the N random circles with 
the fixed circle and let c be the ratio of y to the total area of the fixed circle. Then it is 


desired to find P., where 
Fe, = Pie > Co | Tr, Wr, R, N} 


where Tp, Wr, and R are ino units. Define R* = Wr + aTr where a = a(c, Wr, Tr); 
ja| < 1. It is shown that for N = 1, the family of curves in the RR* plane 
defined by Pc, = constant have a slope, m, given by 


_ 1(RR*) 
m = T(RR*) 





where J, is the modified Bessel Function of k” order. In fact as the product 
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RR* approaches infinity, m approaches unity. From these results, the contours of equal 
probability are easily determined. When N > 1, overlap considerations make the compu- 
tation of explicit values for Pc, intractable. However, in this case, upper and lower 
bounds for P-, can be obtained. 


4. The Problem of the Greater Mean. R. R. BAHADUR AND HERBERT Rossing, 
University of North Carolina, Chapel Hill. 


“Optimum” solutions (in the sense of Wald’s theory of statistical decision functions) 
are obtained for the ‘‘problem of the greater mean’’. Let 7; (¢ = 1,2) be normal popula- 
tions with means m; and common variance ¢o?, alk unknown, and denote the arbitrary but 
given set of possible parameter points w = (m, , mz:c) by 2. Suppose that a set of n; + 
n2 independent observations is drawn, n; from 7; , and let v = (au, +++ , Zing 5 Za, °°, 
Zen,) denote the sample point. Any measurable function f(v) such that 0 < f(v) < 1 iscalled 
a decision function. Given a “risk function” r(f | w) defined for all f and all we, a deci- 
sion function f*(v) is ‘“‘optimal”’ if (7) sup[r(f* | w)] = inf sup [r(f | w)], and (zz) no decision 
function is ‘‘uniformly better’”’ than f*(v). If f*(v) is the unique (up to sets of measure 0) 
decision function with property (7), it is ‘‘optimum’’. Case 1. Given any decision function 
f(v) and any w €Q, let 


r(f | w) = max [m, me] — mE [f| ow |— mE] — flo. 


lif%,>Z — 


0 otherwise j=1 


Let 


It is shown that under certain conditions on Q, f°(v) is optimum. Case 2. Given any decision 
function which takes on only the values 0 and 1, corresponding to the two decisions “‘m, < 
m2’? and ‘‘mz < my,’’ respectively, and any w « Q, let 


r(f|w) = P(incorrect decision | w,f). 


It is shown that under certain conditions on Q, f°(v) is optimal. The conditions on { are 
very similar in the two cases, and are likely to be satisfied in most applications. However, 
it is shown by examples that there exist non-degenerate types of 2 with respect to which 
decision functions other than f°(v) are uniformly better than f°(v). The methods 
of the paper can be applied to a number of similar problems. 


5. Some Extensions of Bayes’ Theorem. F. C. Leone, Case Institute of Tech- 
nology, Cleveland 6, Ohio. 


There is some past or a priori knowledge about the quality of a population of lots anda 
sample is taken from a random lot. What can be said about the lot from which this sample 
is taken? We are incorporating the results of our experiment or sample with the previous 
knowledge to form a judgment. From the a priori distribution and a sample of n with ¢ 
defectives, say two in twenty-five, we form an a posteriori distribution of all two in twenty- 
five cases. From this distribution we can answer questions such as: ‘‘What is the a pos- 
teriort probability that a lot producing a two in twenty-five result should have a propor- 
tion of defectives ten per cent or below?’’? We consider as our a priori situation such 
distributions as the rectangular, triangular, normal, Pearson’s Type III and Type | 
These extensions are applied to some industrial data. In considering lot quality on one 
hundred per cent inspection, the a priori distributions of these data are mostly 
U-shaped with some bell-shaped and J-shaped. In some cases a Pearson Type I proves to 
be a good fit for the a priori distribution. 
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6. On Optimum Selections from Multinormal Populations. Z. W. Brirnsaum 
anp D. G. CuapMan, University of Washington, Seattle. 


Let (X, Yi,--:, Yn) have an (nm + 1)-dimensional non-singular normal probability 
density f(X, Yi,--- , Yn). By “‘selection” in (Y; , --- , Y,) we shall understand a meas- 
urable function ¢(Y; ,--- , Yn) such that 0 < ¢ < 1 for all Y1,--- , Yn. By a “‘trunca- 
tion in (Yi, --- , Yn) to the set 2” we understand a selection g(¥:, --- , Yn) such that 
g = lfor (Y1,--: , Y») inQ, and¢g = 0in@. A “linear truncation” will be a truncation 


n 
to a set defined by a condition of the form 7 c,.Y; > k. Using a slight generalization of 
c=1 
Neyman-Pearson’s fundamental lemma, the following theorems are proven: among selec- 
tions for which the expectation of X, after selection, assumes a fixed value, the one which 
maximizes the ‘‘retained’’ portion of the universe f---f o(¥i, ---, Yn) f(X, Y1, -: 
Y,)dXdY, --- dY, is a linear truncation. Among all the selections for which a given quan- 
tile of X, after selection, assumes a fixed value, the one which maximizes the retained 


portion of the universe is a linear truncation. (Research under the sponsorship of the Office 
of Naval Research). 


7. Simple Regression Analysis with Autocorrelated Disturbances. Howarp L. 
JONES, Illinois Bell Telephone Company, Chicago. 


When the disturbances in a regression equation are connected by a linear difference 
equation, the parameters of both equations can be estimated simultaneously by maxi- 
mizing a function that describes the joint probability of the disturbances or a linear func- 
tion thereof. This note discusses a simple example. 


8. A Test of Klein’s Model III for Changes of Structure. A. W. MarsHaAt.., 
The Rand Corporation, Santa Monica, Calif. 


This paper suggests a test of equations from linear stochastic equation systems on the 
basis of observations not included in the original computation period. Rejection regions 
of approximately the right size (asymptotically correct) are constructed and the use of 
naive economic models as an auxillary test are suggested. The procedure is applied to 
Klein’s Model ITI, the results are tabulated and discussed. 


9. An Application of the Theory of Extreme Values to Economic Problems. 
S. B. Lrrraver, Columbia University, Aanp E. J. Gumpe., New York. 


Most studies of economic time series have been concerned with establishing regularities 
of behavior, often by analogy with mechanical systems. Much as regularity in economic 
phenomena is desirable, such evidence as has been available leaves the reality of 
this sought for regularity considerably in doubt. It seems more fruitful rather to ask the 
question, ‘‘What is the pattern of the non-regularity’’ and if reasonably answered, to offer 
some verifiable form of explanation therefor. It seems further desirable that any attempt 
at “‘scientific’’ explanation of economic phenomena be fortified by evidence of statistical 
stability supported by criteria such as were established by Shewhart for the control of 
quality of manufactured product. In the present instance certain concepts of experimental 
inference, which seem natural therefor, are employed in order to give some general and 
plausible unity to the behavior of economic time series. 

Following upon the postulates of the theory presented here, the appropriate formal 
development employs concepts of statistical quality control and of the statistical theory 
of extreme values. Within this theory the importance of the absence of statistical stability 
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is emphasized, and the relevance of the use of concepts in extreme values is made evident, 
By introducing a superuniverse, peaks and troughs are random expressions of a super 
chance-‘‘cause’”’ system. The use of these statistical concepts is not motivated by mere 
analogy but rather as the natural means for explanation of the phenomena studied. 

A number of examples of the application of these statistical methods to selected series 
are offered as evidence of the workability of the theory here presented. The extremes of 
the Dow-Jones index of selected industrials show that the 1928 value was completely out- 
side the previous levels and should not have been considered as a “stable high plateay 
basic for perpetual prosperity’’. Instead this should have suggested the imminent break. 
down. The validity of the application of the theory of extreme values to these phenomena 
is not so strongly substantiated as are the many applications that have been made of them 
to flood frequencies, wind velocities, extreme temperatures, breaking strengths and other 
natural phenomena. Nevertheless the results here obtained are highly suggestive of g 
tenable economic hypothesis. 


10. Bias Due to the Omission of Independent Variables in Ordinary Multiple 
Regression Analysis. (Preliminary Report). T. A. Bancrorrt, Iowa State 
College, Ames. 


Given n observations of the dependent variate y and the independent variates 2,, 
Zo, *** , Tk, °** , Zr, k <r, all variates measured from their respective sample means, 
and we have calculated the ordinary regression of y on the first k variates and y on all r 
variates. We define ordinary multiple regression as the single-equation approach, error 
only in y which is assumed normally and independently distributed with zero mean and 
variance o? , the z; being fixed from sample to sample. 

In order to determine whether to omit or retain the last (r — k) independent variates 
we formulate a rule of procedure: calculate Snedecor’s F = 


Reduction in Sy? due to (r — k) variates/(r — k) 
Error mean square after fitting all r variates 


If F is non-significant at some assigned significance level a, we pool the sums of squares 
and degrees of freedom, involved in the numerator and denominator of F, to obtain an 
estimate of the error o? , and fit y on the first k variates only. If F is significant at the 
assigned significance level we use the denominator only in F for our estimate of o* and 
hence fit y on all r variates. 

The object of this investigation is to determine the bias in our estimate e* of o°, if we 
follow such a rule of procedure. The bias turns out to be 


207 X +e 5 I ee 
hi e — = 4 
mi + nN i=0 ™ z 2 
Ne MN “ —2i No mM rt 
-Inl—,= Ini =.= +¢)1— 
» (2, +5) =e o(B.E +i) ]% 


Ne cant 
where m= — he ees 


Wa oe 
ne + nia Qe? 








n, and nz are the respective degrees of freedom for the numerator and denominator of F, 


> 

and 7 (8;)? is a function of the population regression coefficients Br+: , --- , Br . The bias 
i=k+1 

is discussed for selected values of the parameters involved. 
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11. Estimating Parameters of Pearson Type III Populations From Truncated 
Samples. A. C. CoHEn, Jr., The University of Georgia, Athens. 


The method of moments is employed with ‘single’ truncated random samples (1) to es- 
timate the mean, yn, and the standard deviation, o, of a Pearson Type III population 
when a3 is known and (2) to estimate yu, ¢, and as when only the form of the distribution 
is known in advance. No information is assumed to be available about the number of 
variates in the omitted portion of the sample. The results obtained can be readily ap- 
plied to practical problems with the aid of “Salvosa’s Tables of Pearson’s Type III 
Function.” An illustrative example is included in the paper. 


12. The Cyclical Normal Distribution. E. J. GumBEL, New York. 


The usual normal distribution becomes invalid for variates, like an angle, lying on 
the circumference of a circle. The distribution of such variates was established by 
R. von Mises by the same methods as used for the classical derivation. The cyclical normal 
distribution is symmetrical about a mode and antimode. The probability function is pro- 
portional to an incomplete Bessel function of the first kind and of order zero for an imag- 
inary argument, and contains two parameters, the direction of the resultant vector and a 
parameter k linked to the absolute amount of the vector. The parameters may be estimated 
by the method of maximum likelihood. For k = 0, the distribution degenerates into a uni- 
form cyclical distribution. If k is of the order 3, the distribution approaches the linear 
normal one, k being the reciprocal of the variance. With increasing values of k, the dis- 
tribution looses its cyclical character and becomes concentrated in a narrow strip. This 
distribution holds for symmetrical unimodal values varying according to pure chance 
about a unique mode in a closed space (as the angles of the wind directions) or a closed 
time, and gives a theoretical model for the variations of temperatures, pressures, rain- 
falls, storms, discharges, floods, death- and birth rates over the year, and earth quakes 
over the day. The comparison between theory and observations in plotting the square 
roots of the frequency on polar coordinate paper provides a statistical criterion for the 
regularity of cyclical phenomena. (Work done in part under contract W 44/109/QM /2202 
with the Research and Development Branch, Office of the Quartermaster General). 


13. Treatment of Attenuation Problems by Random Sampling. H. KAHN ANnp 
T. Harris, The Rand Corporation, Santa Monica, Calif. 


Exact analytical calculations of the transmission of energy by particles through shields 
are difficult; to avoid them random sampling methods may be resorted to. The straight- 
forward procedure of simulating life histories of particles, using random number tables, 
may be used for thin shields, but in the case of thick shields with tremendous attenuations, 
tremendous numbers of particles would be required. In order to obtain reasonably small 
standard errors, using reasonable numbers of simulated life histories, it is necessary to 
modify the original problem to one having a lower attenuation factor, the solution bearing 
a known relation to the solution of the original problem. Alternatively, this may often 
be regarded as an application of well known statistical sampling procedures, such as repre- 
sentative sampling or importance sampling. Various special procedures can be devised. 
One of the first was the splitting technique due to J. v. Neumann. Among others may be 
mentioned the exponential transformation, a simple analytic transformation of the origi- 
nal problem into one having a much lower attenuation factor. 


14. On the Existence of Nearly Locally Best Unbiased Estimates. HeRrMAN 
Rvusin, Stanford University, Stanford, Calif. 


For any family ‘f of distributions, and any distribution F, of ‘f, there exists a bilinear 
function K whose arguments are all parameters defined for all distributions of {F and for 
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which there exist unbiased estimates which have finite variance if Fy is the true distriby. 
tion, and which has the following properties: (1) If 6 is any parameter in the domain of 
K, and ¢ is any unbiased estimate of 6, then var(t | Fo) > K(@, 6). (2) This result is best 
possible, i. e., for any 6 there is an unbiased estimate ¢ of @ whose variance differs from 
K(@, 6) by less than any preassigned amount. 


15. The Experimental Evaluation of Multiple Defiinite Integrals. Grorce W., 
Taytor, U. 8. Army Electronics Laboratory, San Diego, Calif. 


When one is forming an estimate of the total, or mean value, of some quantity, sam- 
pling at carefully selected points will frequently be preferable to employing a method 
which involves randomization. Tue estimation of the total volume of water in a given 
lake or the amount of energy being released in a given time and space, are examples of 
problems where specified points for sampling should result in a reduction in the error of 
estimate. These and similar problems lead naturally to numerical integration methods. 
In the case of single integrals, Gauss’ and Tchebychef’s formulae yield maximum efficiency 
with respect to controlling the polynomial error and statistical error respectively, but 
often the Newton-Cotes formulae can be applied more conveniently. 

For the evaluation of double integrals, an eight point and a thirteen point formula for 
fifth degree accuracy and a twelve point and a twenty-one point formula for seventh de- 
gree accuracy have been developed for integrating over a rectangle and similar formulae 
have been developed for integrating over areas bounded by a parabola and a straight 
line or by two parabolas. The following system of equations is employed in developing 
these formulae: 


™ 
>> Raz’,y’, = Ci, for all i, j for which ¢ + j < 2n, 
a=1 


“pi 
and where C;; = stave for both 7 and 7 even, 


= 0 otherwise. 

Formulae for the numerical evaluation of triple integrals taken over a rec- 
tangular parallelopiped are developed, including a twenty-one point formula with fifth 
degree accuracy. It is shown that comparable formulae can be developed for integrating 
functions of more than three variables and a 2n + 1 point formula with third degree ac- 
curacy for integrating a function of n variables over a rectangular n-space is obtained. 
16. Tests of Fit of a Cumulative Distribution Function over Partial Range of 

Sample Data. Braprorp F. Kimpaui, New York State Dept. of Public 
Service, New York. 


Case 1. Sample data are completely ordered over range tested. 


Let the n + 1 true frequency differences associated with an ordered random sample of 
n values of x be denoted by u; . The cdf of a theoretical test function based on m of the 
above frequency differences is identified and methods of approximating it are discussed. 


Case 2. Sample data in k ordered groups over range tested. 


Let A; F denote the true frequency differences over the k sample intervals to be covered 
by the test. Let m; denote the number of unit frequency differences u; covered by the ith 
interval. Define M and W by 


M +1 = =m, Msn; 
k 


W=>a,F, W<1. 
k 
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A theoretical function Z is defined by 


Z = (M re + 2) > a [A;F — mW/(M + DP 
= k 


ms 
Set 
Y = Z/W?. 


The cdf of Y is identified and methods of approximation to it are discussed. 


Applications to testing agreement of sample with hypothetical cdf of universe are con- 
sidered for both cases in some detail. 


17. Large Sample Tests for Comparing Percentage Points of Two Arbitrary 
Continuous Populations. A. W. MarsHAaLL AND J. E. Wautsu, The Rand 
Corporation Santa Monica, Calif. 


Let us consider two continuous populations, the first with density function f(z) and 
1002% point @ , the second with density function g(x) and 1008% point ¢g . These two 
populations are arbitrary except that f(@.) ¥ 0, g(¢s) ¥ 0 and both f’(@.), g’(¢g) exist and 
are continuous in the vicinity of the specified points. This paper presents significance 
tests for 0. — $s which are based on large samples from these populations. The exact signifi- 
cance level of a test is not known but its value is bounded within reasonably close limits 
(asymptotically). Efficiency properties of these tests (compared to the corresponding 
noncentral t-tests) are investigated for the case in which both populations are normal 
and the ratio of variances is known. Results are also derived for simultaneously testing 
6. —¢g and f(@.)/g(¢s). These tests have known significance levels (asymptotically). A 
particular application of tests of this type occurs when it is desired to test whether two 
samples came from the same population and agreement of the two populations in a specified 
region is to be emphasized. For this special case, the significance levels of the resulting 
tests are reasonably accurate for moderate as well as large sized samples. 


18. On the Distribution of Wald’s Classification Statistic. H. L. Harrsr, 
Michigan State College, East Lansing. 


A study is made of the distribution of the classification statistic introduced by Wald. 
The exact distribution of V in the univariate case, as obtained by the use of characteristic 
functions and contour integration, is given for both degenerate and non-degenerate cases. 
The problem of classifying an individual into one or the other of two populations, using 
the statistic V, is discussed. In the multivariate case, examples are given of the distribu- 
tion of an approximation to V suggested by Wald. The procedure here consists integrating 
out two variables from the joint distribution of three variables to find the distribution of 
the third. Four cases arise, depending upon whether the sample size and the number of 
variates are even or odd. Since this approximation is valid only for large samples, an at- 
tempt is made to find an approximation which is asymptotically equivalent to it as the 
sample size increases, but which is valid also for small samples. Results are given for a 
sampling experiment performed to determine an empirical distribution of V for a specific 
small sampling case, using a population of 10,000 pieces modeled after Shewhart’s normal 
bowl. Obstacles in the path of practical applications are discussed. 


19. Analysis of Extreme Values. W. J. Drxon, University of Oregon, Eugene. 


Consider a population N(x, o) contaminated by introducing a certain proportion of 
values from a population N (u + As, o?) or N(u, \2e*). The performance of various statistics 
for discovering these contaminators is assessed by sampling methods for samples of size 5 
and 15. (This research was sponsored by the Office of Naval Research). 
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20. A Note On The Variance Of Truncated Normal Distributions. A. C. Conky, 
Jr., The University of Georgia, Athens. 


Formulas are derived whereby the variance of truncated normal distributions can read. 
ily be computed with the aid of an ordinary table of areas and ordinates of the normal 
frequency function. These results are applicable to certain tolerance problems involved 
in Statistical Quality Control. Their use will enable one to make computations required ip 
solving such problems without resorting to Karl Pearson’s relatively inaccessible tables 
of ‘‘Values of the Incomplete Normal Moment Functions’’. 


21. Some Estimates and Tests Based on the r Smallest Values in a Sample 
(By Title). J. E. Watsu, The Rand Corporation, Santa Monica, Calif, 


Let us consider a situation where only the r smallest values of sample of size n are avail- 
able. This paper investigates the case where n is large and r is of the form pn + 0(+/n). 
Properties of some well known estimates and tests of the 100p% population point (based 
on statistics of the type used for the sign test) are investigated. If the sample is from a 
normal population, these nonparametric results have high efficiencies for small values of 
p (at least 95% if p < 1/10). The other investigations are restricted to the case of a nor- 
mal population. Asymptotically ‘‘best”’ estimates and tests of the population percentage 
points are derived for the case where the population variance is known. If the population 
variance is unknown, asymptotically most efficient estimates and tests can be obtained 
for the smaller population percentage points by suitable choices of p and 0(/n). The 
results of the paper have application in the field of life testing. There the r smallest sample 
values can be obtained without the necessity of obtaining the remaining sample values. 
By starting with a larger number of units but stopping the experiment when only a small 
percentage have ‘‘died’’, it is often possible to obtain the same amount of ‘‘information” 
with a substantial saving in cost and time over that required by starting with a smaller 
number of units but continuing until all have ‘‘died’’. 


22. Some Comments on the Efficiency of Significance Tests (By Title) J. E. 
Watsu, The Rand Corporation, Santa Monica, Calif. 


A method sometimes used to measure the efficiency of a significance test consists in 
associating a statistic with the test and defining the efficiency of the test to be the effi- 
ciency of this statistic considered as an estimate. This paper investigates the power func- 
tion implications of this method of defining the efficiency of a test. Examples are presented 
which show that an estimate efficiency of 100#% does not necessarily imply that the corre- 
sponding most powerful test based on 100F% as many sample values has approximately 
the same power function as the given test (for the admissible set of alternative hypothe- 
ses). In several of the examples it was found that estimate efficiency makes no allowance 
for the effect of significance level while the relationship between the power functions of 
the given test and the corresponding most powerful test changes noticeably with respect 
to significance level. Some of these examples are non-asymptotic while others 
are asymptotic. However, results are obtained for the asymptotic case which indicate that 
this equality of power functions does hold for a rather broad class of significance tests if 
the pertinent statistics have distributions which are asymptotically normal. 


23. Application of Sequential Sampling Method to Check the Accuracy of a 
Perpetual Inventory Record. JoserH B. Jeminc, New York. 


The problem of checking the continuing property records of a large utility company is handled 
by an application of the sequential sampling method as developed by the Statistical Research Group, 
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Columbia University. Without the application of a sampling procedure the problem can only be 
solved either by a complete physical inventory which is very costly, or by a cycle check which takes 
many years to complete. By use of the sequential sampling method, results of desired accuracy are 
obtained quickly and at very low cost since an extremely small percentage of field inspection for the 
mass property accounts of any large utility produces satisfactory conclusions. 


a 


NEWS AND NOTICES 
Readers are invited to submit to the Secretary of the Institute news items of interest. 
Personal Items 


Dr. Ralph A. Bradley accepted an appointment as Assistant Professor in the 
Mathematics Department of McGill University, Montreal, Canada after re- 
ceiving his Ph.D. in mathematical statistics at the University of North Carolina 
in June, 1949. 

Mr. Fred J. Clark, Jr. received his master of science degree in mathematics 
from the University of Illinois in August, 1949 and is now employed by the Uni- 
versity of California at the Sandia Laboratory in Albuquerque, New Mexico. 

Professor J. L. Doob is on leave from the University of Illinois to teach at Cor- 
nell University for the academic year 1949-1950. 

Mark W. Eudey obtained his Ph.D. degree in statistics at the University of 
California, Berkeley, and is now Vice President of California Municipal Statis- 
tics, Inc. 

Dr. Joseph L. Hodges, Jr. has been promoted to Assistant Professor and Re- 
search Associate at the Statistical Laboratory, University of California, Berkeley. 

Professor Paul Horst, formerly of the Department of Psychology, University of 
Washington, is now Director of Research at the Educational Testing Service, 
Princeton, New Jersey. 

Dr. Fred C. Leone, formerly an Instructor and a Research Fellow at Purdue 
University, has been appointed Instructor in the Mathematics Department and 
Director of the Statistical Laboratory at the Case Institute of Technology. 

Mr. Fred W. Lott, who has been studying at the University of Michigan for 
his Ph.D., has accepted an assistant professorship at Iowa State Teachers College, 
Cedar Falls, Iowa. 

Dr. Francis McIntyre has resigned as Director of Export Control, Office of 
International Trade, U. S. Department of Commerce, Washington, D. C. to 
accept a post as Director of Economic Research, California Texas Oil Co., 551 
Fifth Avenue, New York, New York. 

Mr. R. B. Murphy, who has been a graduate student at Princeton University 
has accepted an instructorship in the Mathematics Department of Carnegie In- 
stitute of Technology. 

Professor Jerzy Neyman, Director of the Statistical Laboratory, University of 
California at Berkeley, will be on sabbatical leave for the Spring Semester, 1950. 

Mr. Monroe L. Norden, formerly of the Glenn L. Martin Co., is now a Mathe- 
matical Statistician with the Operations Research Office, Johns Hopkins Uni- 
versity, Ft. Lesley, J. McNair, Washington 25, D. C. 
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Mr. D. Martin Sandelius, formerly a Research Assistant in the Institute of 
Statistics, Uppsala, Sweden, has been appointed Lecturer in the Mathematics 
Department, University of Washington, Seattle, for the academic year 1949- 
1950. 

After completing his graduate work at Ohio State University, Dr. William J, 
Schull accepted a position with the Atomic Bomb Casualty Commission. He jg 
now in Japan as a geneticist working on follow-up studies at Hiroshima. 

Miss Elizabeth L. Scott obtained her Ph.D. degree in statistics at the Univer. 
sity of California, Berkeley and was promoted to Lecturer and Research Asso- 
ciate at the Statistical Laboratory. 

Miss Ester Seiden obtained her Ph.D. degree at the University of California, 
Berkeley and was promoted to Lecturer and Research Associate at the Statistical 
Laboratory. 

Mr. Iriving H. Siegel is on leave from his position as Chief Economist at the 
Veterans Administration until June 30, 1950, to serve as Lecturer in Political 
Economy at the Johns Hopkins University and as a member of the Johns Hop. 
kins University Operations Research Office staff. 

Dr. Charles M. Stein, Assistant Professor and Research Associate at the 
Statistical Laboratory, University of'California, Berkeley, will be on leave for the 
academic year 1949-1950 and will be working in Paris as a National Research 
Fellow. 


Alfred James Lotka 


Alfred James Lotka, a Fellow of the Institute, died in Red Bank, New Jersey, 
on December 5, 1949. He was born of American parents in Poland, March 2, 1880, 
and had his early schooling in France. His academic training was received at 
Birmingham, England (B.Sc., 1901, and D.Sc., 1912), Cornell (M.A., 1909), and 
Johns Hopkins (1922-1924). Dr. Lotka came to the Statistical Bureau of the 
Metropolitan Life Insurance Company in 1924 and retired as Assistant Statisti- 
cian in 1947. His major contributions were his highly original work on the mathe- 
matical theory of evolution, on the mathematical analysis of population, and on 
the theory of self-renewing aggregates. Altogether, Dr. Lotka had almost 100 
papers in these fields in technical and scientific journals, both here and abroad. 
The essentials of his work are summarized in his books, ‘“The Elements of Human 
Biology” and ‘“Theorie analytique des associations biologiques.’’ He was, in addi- 
tion, a joint author on several books in the field of public health. 

Dr. Lotka was a past president of the American Statistical Association and of 
the Population Association of America. He had recently been active as American 
Vice-President of the International Union for the Study of Population. 


Statistical Summer Session in Berkeley, Calif. 


Following the established pattern, there will be held this year a Statistical 
Summer Session at the University of California, Berkeley. The faculty will in- 
clude William G. Cochran of Johns Hopkins University, Benjamin Epstein of 
Wayne University, Erich L. Lehmann of the University of California, Paul Lévy 
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of the Ecole Polytechnique, Paris, France and Gottfried E. Noether of New York 
University. 

Courses will be offered on both the graduate and the undergraduate levels. The 
graduate courses, all given during the First Summer Session, June 19 to July 29, 
are meant primarily for students who either have already obtained their Ph.D. 
degree or are working toward it. No specific prerequisites to graduate courses will 
be required. The graduate program includes (i) a course on design of experiments 
and a seminar on analysis of variance by W. G. Cochran, (ii) a course on theory 
of estimation by E. L. Lehmann, and (iii) a course and a seminar on random vari- 
ables and random functions by Paul Lévy. 

Inquiries should be addressed to the Office of the Summer Sessions, 1A Ad- 
ministration Building, University of California, Berkeley 4, California. 

ee 

At a meeting of its Executive Council, AAPOR has laid plans for its 1950 
meetings to be held jointly with the World Association for Public Opinion Re- 
search (WAPOR) at Lake Forest College, near Chicago, June 16 to 20. 

The program which is now being planned will be designed to fit the needs of 
the Association’s membership, which is composed of leaders in both the academic 
and commercial fields. 


(a ee mm 


The Council of the Institute of Mathematical Statistics requested Professor 
Harold Hotelling to communicate to Professor 8. 8. Wilks its appreciation of 
his editorship of the Annals during the years 1938 to 1949. On the recommenda- 
tion of the Council Professor Hotelling’s letter is reproduced below. 

January 6, 1950 
Professor Samuel S. Wilks 
Fine Hall 
Princeton, New Jersey 
Dear Professor Wilks: 

In behalf of the Council of the Institute of Mathematical Statistics and by its 
direction, I write to express the appreciation we all feel for the splendid efforts 
which you have expended so freely upon the Annals of Mathematical Statistics, 
and which have been so conspicuously successful in establishing it as a sound 
and reputable journal. The years of your editorship are memorable ones for the 
history of statistics, and your contribution to making them so is of first im- 
portance. 

Very sincerely, 
Harold Hotelling 


(RR 


New Members 
The following persons have been elected to membership in the Institute 
(August 23, 1949 to November 30, 1949) 


Anderson, Oskar, Ph.D. (Kiel) Professor, University of Munich, Konigin-Strasse 69, 
Munich (Uunchen), Germany 
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Puente Arroyo, Felix Jorge, CPA, (Univ. Nal. Litoral) Professor titular Mathematics, 
Italia 1550, Rosario, Republica Argentina. 
Arvanitis, Ernest A., A.B. (Boston Univ.) Student at Columbia University, 43-18 40th 
Street, Sunnyside, L. I., New York 
Bhatt, Narbheshanker M., Ph.D. (Edinburgh Univ.) Professor of Statistics, Commerce 
College, Behind Raopura Tower, Baroda, India 
Bose, Raj Chandra, D. Litt (Calcutta Univ.) Professor of Mathematical Statistics, Uni- 
versity of North Carolina, 110 Noble Street, Chapel Hill, North Carolina. 
Carreiro, Oscar Ediwaldo Porto, Civil Engineer (Univ. of Brazil) Professor da Faculadade 
de Ciencias Economicas, Avenida Sao Sebastiao 266, Sao Paulo, Brazil. 
Crump, Phelps P., B.S. (Iowa State) Graduate Student and Research Assistant, Box 5457, 
State College Station, Raleigh, North Carolina 
Davis, Richard L., B.S. (North Carolina State) Sales Engineer, Box 304, Charlotte, North 
Carolina 
Dickman, Sidney, A.B. (Brooklyn College) Graduate Student at Columbia University, 
2823 West 25th Street, Brooklyn 24, New York 
Fitzgerald, Rev. John F., 8.J., M.S. (Univ. of Detroit) Assistant Professor of Physics and 
Mathematics, College of the Holy Cross, Worcester 3, Massachusetts. 
Godsey, Ellis B., B.S. (Indiana Univ.) Analytical Statistician, Army Chemical Corps, 
1716 Pin Oak Road, Baltimore 4, Maryland 
Ghurye, S. G. M.Sc. (Univ. of Bombay) Student and assistant, Department of Mathe- 
matical Statistics, c/o The Institute of Statistics, Phillips Hall, Chapel Hill, North 
Carolina 
Gutt, Paul, M.S. (Univ. of Chicago) Ordnance Research #1, Mathematician, 6421 S. 
Ellis, Chicago, Illinois 
Harman, Harry H., S.M. (Univ. of Chicago) Chief, Statistical Research and Analysis 
Unit, Personnel Research Section, AGO, Dept. of the Army, 4111 Maryland Ave. 
(Brookmont), Washington 16, D.C. 
Henderson, Charles R., Ph.D. (Iowa State) Associate Professor, Animal Husbandry 
Department, Cornell University, Ithaca, New York. 
Harter, Harman Leon, Ph.D. (Purdue Univ.) Assistant Professor of Mathematics, Michi- 
gan State College, East Lansing, Michigan. 
Hoffman, William Charles, M.A. (Univ. of Calif. at Los Angeles) Graduate Assistant, 
Department of Mathematics, Cornell University, Ithaca, New York. 
Hydeman, William Robert, M.A. (Syracuse Univ.) Mathematician, U. 8. Navy Depart- 
ment, 3810—39th Street, N.W., Washington 16, D.C. 
Kellerer, Hans, Ph.D. Referent, Bayerisches Statistisches Landesamt, Munchen 8, Rosen- 
heimerstr 130, Germany. 
Kramer, Kenneth H., M.S. (Carnegie Inst. of Tech.) Teaching Assistant at Carnegie 
Institute of Technology, 279 Seneca Street, Turtle Creek, Pennsylvania 
Lieberman, Gerald J., M.A. (Columbia Univ.) Engineer and Mathematical Statistician, 
Statistical Engineering Laboratory, National Bureau of Standards, Washington 
25, D. C. 
Lindley, Dennis V., M.A. (Cantab) University Demonstrator in Mathematics, Statistical 
Laboratory, St. Andrews Hill, Cambridge, England. 
Malan, A. P., M.Sc. (South Africa) Professor, U.C.O.F.S., Bloemfontein, South Africa. 
Rasch, G., Ph.D. (Copenhagen) Chief of Statistical Department, State Serum Institute, 
Copenhagen, Denmark 
Recao, Manuel Felipe, B.A. (Univ. Venezuela) Director General de Estadistica, Minesterio 
de Fomento, Professor of Mathematics, Facultad Ciencias Economics, Central Uni- 
versity, Calle Real Chacao, Quinta ‘‘La Paz,’’ Chacao, Estado Miranda, Venezuela. 
Riggs, Charles L., Ph.D. (Univ. of Kentucky) Assistant Professor of Mathematics, De- 
partment of Mathematics, Kent State University, Kent, Ohio. 
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Saxer, Walter, Ph.D. Professor a.d. Eldg. Techn. Hochschule, Zurich, Goldbach-Kusnacht, 
Switzerland. 

Scobert, Whitney, M.S. (Univ. of Oregon) Associate Professor of Mathematics, Mathe- 
matics Department, Idaho State College, Pocatello, Idaho. 

Serfling, Robert E., Ph.D. (Univ. of Mich.) Senior Scientist, Officer in Charge, Statistical 
Branch, Epidemiology Division, Communicable Disease Center, U.S. Public Health 
Service, Atlanta, Georgia. 

Steyn, Hendrik S., Ph.D. (Univ. of Edinburgh) Lecturer in Statistics, University of Pre- 
toria, 305 Fourth Private Avenue, Villieria, Pretoria, South Africa. 

Zacharias, William B., A.M. (Univ. of Pennsylvania) Instructor in Mathematics, Temple 
University , 1529—67th Avenue, Philadelphia 26, Pennsylvania 

Zeigler, R. K., Ph.D. (Univ. of Iowa) Associate Professor of Mathematics, Mathematics 
Department, Bradley University, Peoria 5, Illinois. 


RI 


REPORT OF THE NEW YORK MEETING OF THE INSTITUTE 


The twelfth Annual Meeting of the Institute of Mathematical Statistics was 
held in New York City on December 27-30, 1949. Headquarters were at the 
Biltmore Hotel where most of the sessions were held; one or more of the sessions 
were held at the Hotel Commodore, the McAlpin Hotel, and the Governor Clin- 
ton Hotel. The meeting was held in conjunction with the Annual Meeting of the 
American Statistical Association, the American Association for the Advance- 
ment of Science, the American Mathematical Society, the Econometric Society, 
the Psychometric Society, the Mathematical Association of America, the Asso- 
ciation for Computing Machinery, and the American Psychological Association. 
The following 214 members of the Institute attended: 


F.S. Acton, P.H. Anderson, R. L. Anderson, T. W. Anderson, H. E. Arnold, K. J. Arnold 
Max Astrachan, R. R. Bahadur, E. W. Bailey, T. A. Bancroft, W. D. Baten, E. E. Blanche, 
C. 1. Bliss, R. C. Bose, A. H. Bowker, R. A. Bradley, Dorothy Brady, A. E. Brandt, I. D. J. 
Bross, T. H. Brown, O. P. Bruno, P. T. Bruyere, R. W. Burgess, J. M. Cameron, B. H. Camp, 
E. W. Cannon, S. D. Canter, Bernard Carol, O. S. Carpenter, Maria Castellani, Jack Chas- 
san, Randolph Church, Edmund Churchill, W. G. Cochran, A. C. Cohen, Jr., R. H. Cole, 
E. P. Coleman, F. G. Cornell, Jerome Cornfield, C. C. Craig, M. T. Crapsey, J. F. Daly, 
D. A. Darling, Besse B. Day, F. R. Del Priore, W. E. Deming, Philip Desind, W. J. Dixon, 
C. W. Dunnett, Solomon Dutka, P. 8. Dwyer, Benjamin Epstein, W. D. Evans, W. T. Fed- 
erer, William Feller, J. W. Fertig, Leon Festinger, C. H. Fischer, J. C. Flanagan, M. M. 
Flood, L. R. Frankel, N. M. Franklin, H. A. Freeman, Bernard Friedman, Melitta L. Gar- 
buny, E. F. Gardner, M. A. Geisler, H. H. Germond, Leon Gilford, Abraham Golub, William 
Gomberg, C. H. Graves, 8S. W. Greenhouse, J. A. Greenwood, Evelyn S. Grossman, H. T. 
Guard, Carl Hammer, E. C. Hammond, H. H. Harman, T. E. Harris, Boyd Harshbarger, 
H. L. Harter, W. A. Hendricks, L. H. Herbach, J. L. Hodges, Jr., Wassily Hoeffding, Helen 
M. Humes, Harold Hotelling, Cuthbert Hurd, H. M. Hughes, W. R. Hydeman, S. M. Ikh- 
tiar-ul-Mulk, S. I. Isaacson, Marcus Jacobs, W. W. Jacobs, J. E. Jackson, Carol M. Jaeger, 
J.B. Jeming, R. J. Jessen, H. L. Jones, Alice S. Kaitz, W. C. Kalinowski, Leo Katz, R. D. 
Keeney, B. F. Kimball, Leslie Kish, Lila F. Knudsen, Paul Koditschek, C. F. Kossack, K. 
H. Kramer, R. R. Kuebler, Jr., S. M. Kwerel, R. B. Ladd, Marguerite Lehr, F. C. Leone, 
Joseph Lev, Howard Levene, G. J. Lieberman, Julius Lieblein, S. B. Littauer, Simon Lopata, 
Irving Lorge, E. D. Lowry, L. H. Madow, W. G. Madow, Benjamin Malzberg, Joseph Man- 
delson, E. S. Marks, Margaret P. Martin, J. W. Mauchly, P. J. McCarthy, Margaret Merrell, 
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Albert Mindlin, P. D. Minton, Robert Mirsky, A. M. Mood, Doris N. Morris, R. H. Morris, 
Dorothy J. Morrow, J. W. Morse, J. E. Morton, Judith Moss, R. G. Moss, Frederick Mostel- 
ler, C. M. Mottley, Hugo Muench, L. F. Nanni, Doris Newman, G. E. Noether, M. L. Nor- 
den, J. A. Norton, Jr., H. W. Norton, E. G. Olds, P. S. Olmstead, A. L. O’Toole, W. R. 
Pabst, Jr., R. E. Patton, Katherine Pease, G. W. Petrie, B. E. Phillips, E. W. Pike, Aditya 
Prakash, Frank Proschan, J. E. Raup, L. J. Reed, J. S. Rhodes, P. R. Rider, H. G. Romig, 
Norman Rudy, Marion M. Sandomire, F. E. Satterthwaite, Mary Ann Savas, M. A. Schnei- 
derman, Samuel Schweid, O. A. Shaw, G. D. Shellard W. A. Shewhart, S. S. Shrikhande, 
Harry Shulman, I. H. Siegel, Rosedith Sitgreaves, G. W. Snedecor, Herbert Solomon, D. E. 
South, Mortimer Spiegelman, R. G. D. Steel, J. R. Steen, Arthur Stein, Joseph Steinberg, 
F. F. Stephan, A. I. Sternhell, J.S. Stock, J. G. Strieby, J. V. Sturtevant, W. R. Thompson, 
L. J. Tick, Gerhard Tintner, M. M. Torrey, J. W. Tukey. G. W. Tyler, 8. A. Tyler, Uttam 
Chand, D. F. Votaw, Jr., Helen M. Walker, W. A. Wallis, Samuel Weiss, E. L. Welker, D. R. 


Whitney, Frank Wilcoxon, R. I. Wilkinson, 8. 8. Wilks, C. P. Winsor, M. A. Woodbury, 
Holbrook Working. 


The opening session on Tuesday, December 27, 9 A. M., held jointly with the 
American Statistical Association and the American Mathematical Society, was 
devoted to Operations Research, with Professor J. Steinhardt, Operations Evalu- 
ation Group, Massachusetts Institute of Technology presiding. The following 
papers were presented: 


1. Topics on the Methodology of Operations Research. B. O. Koopman, Columbia Univer- 
sity. 

2. Some Applications of the Mathematical Theory of Games. G. E. Kimball, Columbia Uni- 
versity. 


3. Theory of Games. L. Gillman, Operations Evaluation Group, Massachusetts Institute 
of Technology. 


4. Development of Theories of Action. Ellis Johnson, Operations Research Office. The Johns 
Hopkins University. 

5. Some Industrial Applications of Operations Research. A. A. Brown, Operations Evalua- 
tion Group, Massachusetts Institute of Technology. 


At the second session, held jointly with the American Statistical Association, 
at 2:30 P. M. on the opening day, Professor M. Loeve, University of California, 
gave a special invited address entitled, Fundamental Limit Theorems in Prob- 
ability. The discussion was presented by Professor Will Feller of Cornell Uni- 
versity and Professor H. E. Robbins of the University of North Carolina. 
Professor Abraham Wald of Columbia University served as chairman. 

The first contributed papers session was held on the same day at 4:00 P. M., 
with Professor W. D. Baten of Michigan State College and Michigan Agricul- 
tural Experiment Station as chairman. The following papers were presented: 


1. The Asymptotic Distribution of the Extremal Quotient. E. J. Gumbel, New York, and R. 
D. Keeney, Metropolitan Life Insurance Company, New York. 

2. A Second Formula for Partial Sums of Hyper-geometric Series Having the Unit as Fourth 
Moment. Hermann von Schelling, Naval Medical Research Laboratory, New London, 
Connecticut. 

3. A Coverage Distribution. Herbert Solomon, Office of Naval Research, Washington, 
D.C. 

4. The Problem of the Greater Mean. R. R. Bahadur and Herbert Robbins, University of 
North Carolina. 
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5. Some Extensions of Bayes’ Theorem. F. C. Leone, Case Institute of Technology. 


6. On Optimum Selections from Multinormal Populations. Z. W. Birnbaum and D. G. Chap- 
man, University of Washington. 


On Wednesday morning, December 28, at 10:00 A. M. a session on Cyber- 
netics was held jointly with the American Statistical Association and the 
American Mathematical Society. The following papers were given: 


1. Technique of Multiple Prediction. Norbert Wiener, Massachusetts Institute of Tech- 
nology. 


2. Stochastic Problems in Neurophysiology. Walter Pitts, Massachusetts Institute of 
Technology. 


3. Information Theory. Claude Shannon, Bell Telephone Laboratories. 


with discussion by Professor J. L. Doob, University of Illinois, Professor Mark 
Kac, Cornell University, and Professor L. J. Savage, University of Chicago. 
Professor Jerzy Neyman, University of California was Chairman of the session. 

The session on Review of Statistical Methodology was held jointly with the 
American Statistical Association at 2:00 P. M., Wednesday, December 28, with 
Professor W. A. Wallis, University of Chicago, as chairman. The two papers 
presented were: Review of Statistical Methodology in Agriculture and Related 
Fields, by Professor W. 'T. Federer, Cornell University and Recent Developments 
in Statistical Methodology in Social Science, by Professor Frederick Mosteller, 
Harvard University; discussion followed by Professor L. J. Savage of the Uni- 
versity of Chicago. 

The second session of contributed papers was held jointly with the American 
Statistical Association and the Econometric Society on Thursday, December 
29, at 10:00 A. M., with Professor H. T. Davis of Northwestern University 
presiding. The following papers were presented: 


1. Simple Regression Analysis with Autocorrelated Disturbances. Howard Jones, Illinois 
Bell Telephone Company. 
. Application of Sequential Sampling Method to Check the Accuracy of a Perpetual Inven- 
tory Record. Joseph Jeming, New York City. 
. A Test of Klein’s Model III for Changes of Structure. Andrew Marshall, Rand Corpora- 
tion. 
. Application of the Theory of Extreme Values to Economic Problems. S. B. Lit- 
tauer, Columbia University and E. J. Gumbel, New York City. 
. Bias Due to the Omission of Independent Variables in Ordinary Multiple Regression 
Analysis. T. A. Bancroft, lowa State College. 
6. Estimating Parameters of Pearson Type III Populations from Truncated Samples. A. C. 
Cohen, Jr., University of Georgia. 
7. The Circular Normal Distribution. E. J. Gumbel, New York City. 


The third session of contributed papers was held at 2:00 P. M. on Thursday, 
December 29, with Professor L. C. Aroian of Hunter College as Chairman. The 
following papers were presented in person or by title as indicated: 


1. Treatment of Attenuation Problems by Random Sampling. H. Kahn and T. Harris, The 
Rand Corporation. 


2. On the Exstence of Nearly Locally Best Unbiased Estimates. Herman Rubin, Stanford 
University. 








154. REPORT OF NEW YORK MEETING 


3. U'he Experimental Evaluation of Multiple Definite Integrals. George Tyler, Naval Elec- 
tronics Laboratory, San Diego, California. 

4. Tests of Fit of a Cumulative Distribution Function Over Partial Range of Sample Data, 
Bradford Kimball, New York State Department of Public Service, New York City. 

5. Large Sample Tests for Comparing Percentage Points of Two Arbitrary Continuous 
Populations. A. W. Marshall and John Walsh, The Rand Corporation. 

6. On the Distribution of Wald’s Classification Statistics. Harman L. Harter, Michigan 

State College. 

. Analysis of Extreme Values. W. J. Dixon, University of Oregon. 

8. A Note on the Variance of Truncated Normal Distributions. (By title) A. C. Cohen, Jr., 
University of Georgia. 

9. Some Comments on the Efficiency of Significance Tests. (By title) John Walsh, The Rand 
Corporation. 


10. Some Estimates and Tests Based on the Smallest Values in a Sample. (By title) John 
Walsh, The Rand Corporation. 

The subject of the next session, 4:00 P. M. Thursday, December 29, was the 
Review of Stochastic Processes from the Point of View of Mathematical Statistics. 
This session was held jointly with the American Statistical Association, Pro- 
fessor C. C. Craig of the University of Michigan presiding. Two papers were 
given, one by Professor A. B. Mann of the National Bureau of Standards, Ohio 
State University and the University of California; and the second by Professor 
John Tukey, Princeton University. 

On Friday, December 30, at 9:00 A. M. a session on Statistical Methods in 
Astronomy was held jointly with the American Statistical Association and Section 
D of the American Association for the Advancement of Socience. Professor 
Walter Bartky of the University of Chicago, Chairman of the session, opened the 
meeting with introductory remarks on Astronomical Problems Requiring Sta- 
tistical Methods. The following papers were presented: 

1. The Nearby Stars. Peter Van De Kamp, Swarthmore College. 

2. Corrections to Observed Frequency Distributions. Bart J. Bok and J. K. De Jonge, Har- 

vard University. 

3. The Problem of Selective Identifiability of Binaries. Elizabeth Scott, University of Cali- 

fornia. 

4. Multivariate Periodogram Analysis and Detection of Variable Stars. Harold Hotelling, 

University of North Carolina. 

These papers were discussed by Professor Jerzy Neyman, University of 
California. 

The session on Discriminant Functions in Education was held jointly with the 
American Statistical Association, the American Psychological Association and 
the Psychometric Society. Professor T. W. Anderson of Columbia University 
gave an invited address on Classification by Multivariate Measures, followed by 
discussion by Professors J. C. Flanagan of the University of Pittsburgh and 
John Carroll of Harvard University. Professor Robert Thorndike of Columbia 
University presided. 

The final session of the meeting was devoted to Computation and was held 
jointly with the American Statistical Association and the Association for Com- 
puting Machinery. Professor Harold Hotelling of the University of North Caro- 
lina serving as Chairman. The following papers were given: 
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. Idiosyncrasies of Automatically-sequenced Digital Computing Machines. Ida Rhodes, Na- 
tional Bureau of Standards. 

Problem Solving on Large-Scale Automatic Calculating Machines. W. D. Woo, Harvard 
University. 

3. A Statistical Application of the UNIVAC. John Mauchly, Eckert-Mauchly Computer 
Corporation. 


~ 


These papers were discussed by James McPherson, Bureau of the Census and 
Emil Schell, Office of the Air Comptroller. 

Meetings of the Council were held on Tuesday, December 27, at 12:00 Noon, 
Professor Jerzy Neyman presiding and again on Thursday, December 29, at 
12:00 Noon, Professor J. L. Doob presiding. The Business Meeting was held on 
Wednesday, December 28, Professor Jerzy Neyman presiding. The report of 
this meeting is given elsewhere in this issue. 

S. B. Lirraver, 
Associate Secretary 


a 


MINUTES OF THE ANNUAL MEMBERSHIP MEETING, NEW YORK, 
DECEMBER 28, 1949 


The meeting was called to order at 4:30 P.M. by President Jerzy Neyman. 
The annual reports of the President, Editor, and Secretary-Treasurer were read. 
They are printed elsewhere in this issue. 

It was moved by Harold Hotelling that the front cover of the Annals in the 
future shall bear the additional notation that it was edited during the years 
1938-1949 by S. S. Wilks. Motion was seconded and carried unanimously. 

The tellers reported the election of the following officers: 


President-Elect P. 8. Dwyer 

Members of the Council for 1950-1952 David Blackwell 
W. G. Madow 
Frederick Mosteller 
L. J. Savage 


Meeting was adjourned at 5:15 P.M. 
Car H. FIscHER 
Secretary 
(rn A ae 


REPORT OF THE PRESIDENT OF THE INSTITUTE FOR 1949. 


I wish to begin my Report by welcoming the newly elected Fellows, Doctors 
Z. W. Birnbaum, D. J. Finney, H. O. Hartley, Wassily Hoeffding, Michel 
Loéve, Edward Paulson and S. N. Roy. In addition, a hearty welcome is due 
to Dr. G. W. Brown who was elected last year, but inadvertently omitted in the 
published list. The election to the fellowship is a mark of recognition on the part 
of the Institute. At the same time, I am sure the Institute has reason to be proud 


of having among its fellows such distinguished scholars as are now added to the 
list. 
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During the past year the intensity of the Institute’s life grew markedly in 
many respects. In particular, a very considerable number of our members took 
part in various Committees. For the sake of brevity, the composition of all the 
Committees is given in a tabular form at the end of the Report. At this time | 
wish to express the indebtedness of the Institute to the Chairmen and to the 
Members of all the Committees. 

Undoubtedly the most important function of the members of the Institute is 
research and the most important function of the Institute itself is the publica- 
tion of the results of this research. In this respect the past year brought about a 
fundamental change: after a dozen years of hard and most fruitful work as 
Editor of the Annals, Professor S. S. Wilks resigned this year and the Council 
elected Professor T. W. Anderson as his successor. According to our present 
Constitution, the term of office of the Editor is three years. 

About a decade ago I suggested and the Membership Meeting of the Institute 
approved that the cover of the Annals bear the name of its founder, Professor 
Harry Carver. Founded by Carver, the Annals were developed by Wilks and, 
now stand as the most important statistical journal in the world. Accordingly 
the Chair will welcome a motion to add Professor Wilks’ name as a permanent 
feature of the cover of the Annals of Mathematical Statistics. 

While being grateful to Wilks and regretting his withdrawal, we should ex- 
tend a most hearty welcome to T. W. Anderson. Because of his scholarship, 
broad vision combined with broadmindedness and because of his energy, he is 
an excellent promise for the future of the Annals. It is a pleasure to express the 
gratitude of the Institute to Columbia University and, in particular, to Dr. 
Abraham Wald for providing the necessary facilities for the Editorial office of 
the Annals. 

Prior to embarking on the election of the new Editor, the I.M.S. Council 
approved an important document prepared by a special Committee chaired by 
S. 8S. Wilks, formulating the editorial policy of the Institute. 

Of the many fundamental parts of this document I wish to mention the fol- 
lowing: 

(i) “‘In establishing the editorial procedure, special care should be taken to 
avoid the danger of the Annals becoming a one-group journal rather than 
serving the Institute as a whole...the refusal to publish a paper on 
grounds of general policy (rather than because of some verifiable defects 
such as mistakes, triviality, lack of new material, etc.) shall be based on 
a unanimous agreement of the Editor and of all the Associate Editors.” 

The general idea behind these passages is, of course, that thus far, the Annals 
is the only journal published by the Institute and should provide facilities for 
all the different schools of thought. My understanding is that this includes the 
biostatistician Cochran and the econo-statistician Koopmans, the multivariate 
Hotelling and the tolerant Wilks, the quality-control-minded Shewhart and 
the dependently-limiting Loéve, the necessary- and sufficient-normal Feller and 
the minimax-gambler von Neumann, the relativistically-cybernetic Wiener and 
the general-sequential-decision-maker Wald. I should think that even our next 
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President, the stochastically-processed-Markovian Doob, is meant to have a 
chance to publish in the Annals, from time to time. 

(ii) Another interesting point in the same document concerns the proposed 

approximate distribution of space in the Annals: 

(a) research papers on mathematical statistics proper—60 per cent; 

(b) research papers in borderline fields, including applications—20 per 
cent; 

(c) expository papers—l5 per cent 

(d) news, notices, ete.—5 per cent. 

Since in the past there was too little expository material, the Council insti- 
tuted the so-called Special Inivited Papers, to be presented from time to time on 
selected subjects. The text of these papers, accompanied by the prepared dis- 
cussion, will be printed in the Annals. The program of the present meeting in- 
cludes our first Special Invited Paper, by Michel Loéve. It is hoped that the 
Special Invited Papers will satisfy the need for expository material now felt by 
the membership of the Institute. I am sure the Program Committees will appre- 
ciate suggestions of the Members regarding the sections of the theory requiring 
expository presentation. 

The financial aspect of the publication program of the Institute was a con- 
tinued worry of the Council. As is well known, the Annals is overloaded with 
papers and the cost of printing is growing constantly. In order to ease the situ- 
ation somewhat, our new Constitution was amended to include the provision 
that the Universities and other institutions could become Institutional Members. 
There is already some additional income from this source and, if all the members 
of the Institute are energetic in urging their Departments to become Institu- 
tional Members, this income may be quite substantial. 

It is conceivable that some potential sources of funds exist, not directly avail- 
able for the Annals, which may be used for starting a new statistical journal. 
In order to investigate this possibility a special committee was appointed under 
the chairmanship of Professor Scheffé. This Committee did an excellent job in 
trying to find a solution of the tremendously difficult problem and there is now 
a reasonable hope that, in the not very distant future, our publication facilities 
will be increased. 

Another deep change in the structure of the Institute occurred this year. 
Here I have in mind the resignation of Dr. Paul S. Dwyer, our long and hard 
working Secretary, and the taking over by Dr. Carl Fischer. Dr. Dwyer’s resig- 
nation was announced last year at the meeting at Cleveland and we expressed 
to him our hearty thanks for his untiring work for the Institute. I wish to repeat 
these thanks now and to accompany them by the hearty congratulations on the 
excellent program he prepared for this meeting in his new capacity as the Chair- 
man of the National Program Committee. 

Until recently, there was a certain disequilibrium in the location of the meet- 
ings of the Institute. Practically all of the meetings were held in the East and 
the West Coast members could attend them only as a matter of exceptional luck. 
Later, regional meetings were organized, and this year we have functioning three 
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Regional Program Committees, one for the East, one for the West Coast and 
one for the Middle West. In addition, we have Program Committees for the two 
National Meetings of the Institute. In parallel with the redistribution of meet- 
ings, there was an increase in their number. This process was accompanied by 
the very efficient help on the part of the governmental organizations, of the 
Office of Naval Research, the Air Force, and the Army, for the members of the 
Institute to attend the meetings even if they are held at a considerable distance. 
As a combined result of these developments it now may seem that there are too 
many meetings. Undoubtedly, the number and the location of future meetings 
of the Institute will be seriously discussed and adjusted to the existing needs. 
Naturally, the help of the Governmental institutions was not limited to help 
in travel. A considerable number of research projects in statistics are now in 
progress in many institutions with excellent results for science, for the younger 
people who are given the chance to make their first independent research work 
without undue worry about food and shelter and, thus, for the country as a whole. 
The first organization to support fundamental research in general, and in sta- 
tistics, in particular, seems to be the office of Naval Research. Its broadminded- 
ness and understanding of the spirit of research have established a very high 
standard which is also sustained by other institutions. If permitted to function 
as they do now, these institutions will mark an epoch in the development of 
scholarly work in this country. 
The following persons have accepted the appointment to the Nominating 

Committee for the next year 

Henry Scheffé—Chairman 

Albert W. Bowker 

Paul G. Hoel 

Leonid Hurwicz 

Herbert E. Robbins 

David F. Votaw, Jr. 


Composition of the Committees of the Institute in 1949 


1. Program Committees (P.C.) 
(i) Eastern P.C. for the April 1949 (ii) West Coast P. C. for June meeting 
meeting in New York - in Berkeley 
Churchill Eisenhart, Chairman M. A. Girshick, Chairman 
W.G. Cochran Z. W. Birnbaum 
C. F. Kossack W. J. Dixon 
S. B. Littauer J. L. Hodges, Jr. 
F. Mosteller P. G. Hoel 
A. M. Mood 
National P.C. for the Summer Mid West P.C. 
Meeting at Boulder, Colorado 
W. Feller, Chairman C.C. Craig. Chairman 
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J. L. Doob L. Hurwiez 
M. A. Girshick W.G. Madow 
C.C. Hurd K. May 
J. Wolfowitz L. J. Savage 
D. R. Whitney 
(v) National P.C. for the Decem- (vi) Eastern P.C. for the Spring 1950 
ber meeting in New York meeting in North Carolina. 
P.S. Dwyer, Chairman H. Hotelling, Chairman 
J. Berkson D. Blackwell 
G. W. Brown H. Geiringer 
C. Eisenhart S. B. Littauer 
Mark Kae D.F. Votaw, Jr. 
H. Rubin 8.8. Wilks 
. Committee for Special Invited Papers 
J.W. Tukey, Program Coordinator, Chairman ex officio 
C. C. Craig W. Feller 
P.S. Dwyer M. A. Girshick 
C. Eisenhart H. Hotelling 
. Committee on Editorial Policy (1948-1949) 
8.58. Wilks, Chairman 
W. G. Cochran 
W. Feller 
M. A. Girshick 


P.S. Olmstead 
J. Neyman 
W.A. Wallis 


J. Wolfowitz 

. Committee to Nominate Candidates for the Editor of the Annals 
Harry C. Carver, Chairman Howard Levene 
David Blackwell Frederick Mosteller 
S. Lee Crump Herbert E. Robbins 
Erich L. Lehmann 

. Committee on Tabulation 

C. Eisenhart, Chairman C. C. Hurd 

C. I. Bliss A. N. Lowan 

F. W. Dresch W.G. Madow 

H. H. Germond H. G. Romig 

H. O. Hartley L. E. Simon 

). Commitiee on Directory 

John W. Tukey, Chairman 

Churchill Eisenhart 

. Committee to Revive the Statistical Research Memoirs 

Henry Scheffé, Chairman C. C. Hurd 

T. W. Anderson George Kuznets 
Walter Bartky 
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8. Rietz Lectures Committee 


The Chairmanship of this Committee was accepted by Abraham Wald, 
the first Rietz Lecturer, who undertook to make further appointments. These 
are: 

C. C. Craig 
W. Feller 


. Committee to Encourage Membership outside of the United States 


T. W. Anderson, Chairman 

C. C. Hurd 

M. Loéve 

J. Marschak 

Committee on Statisticians in the Government Service 

W.E. Deming, Chairman 

C. Eisenhart 

Representative of the I.M.S. to the American Association for the Advancement 
of Science 

Harold Hotelling 

Representative of the I.M.S. to the National Research Council, Division of 
Physical Sciences 

Walter Bartky (1948-1950) 

Representative of the I1.M.S. to the Mathematical Policy Committee 

S.S. Wilks 

Representative of the I.M.S. to the Joint Committee for Development of Statistical 
Applications in Engineering and Manufacturing 

Benjamin Epstein 


. Representatives to the Inter-Society Cooperation on Mathematical Training of 


Social Scientists 
T. W. Anderson 
J. L. Doob 
8.8. Wilks 
Committee to Determine the Duties and Responsibilities of the Program Com- 
mittees 
Harold Hotelling, Chairman 
M. A. Girshick 
S. B. Littauer 
J. NEYMAN 
President 


December 31, 1949 
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REPORT OF THE SECRETARY-TREASURER OF THE INSTITUTE 


FOR 1949 


At the beginning of 1949 the Institute had 1101 members and during the 
period covered by this report 153 new members (8 of whom begin their member- 
ship with 1950) joined the Institute and two members were re-instated. During 
1949 the Institute lost 87 members of which 27 were by resignation and 60 by 
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suspension for non-payment of dues. Judging from the information available at 
this date, the Institute will have 1167 members as it starts 1950. 

During 1949 the Constitution was amended to provide for a new class of mem- 
bership: Institutional Membership. Although the campaign for institutional 
members started late in the year, by December 31 there were five universities on 
the rolls: California, Purdue, Illinois, Princeton and North Carolina. It is hoped 
that many more universities and corporations will enroll during 1950. 

Meetings of the Institute held during 1949 included those at Columbia Uni- 
versity on April 8-9, at the Berkeley campus of the University of California on 
June 16-18, at the University of Colorado on August 29-September 1, and at 
New York City on December 27-30. The Secretary wishes to call attention to 
the excellent work of the members who served as Assistant and Associate Secre- 
taries at these meetings: Professor S. B. Littauer at New York, Professor J. L. 
Hodges, Jr., at California, Professor H. T. Guard at Colorado and Associate 
Secretary Professor Littauer who was responsible for the New York Meeting. 

The following Fellows served as members of the Committee on Fellows: C. 
C. Craig, chairman, T. W. Anderson, M. A. Girshick, Harold Hotelling, Henry 
Scheffé, and F. F. Stephan. 

The meeting scheduled for November 25-26 at the University of California 
at Los Angeles was cancelled by vote of the West Coast membership because of 
the proximity of the Boulder and Christmas Meetings. 

At the Council meeting at Boulder, August 29, 1949, the following Associate 
Secretaries were elected: 


Associate Secretary Section 
S. B. Littauer Eastern 
K. J. Arnold Central 
J. L. Hodges, Jr. Western 


By a mail vote of the Council, conducted during October, 1949, 'T. W. Ander- 
son was elected Editor for the period 1950-1952. 
A summary of the financial status of the Institute is given below: 


FINANCIAL STATEMENT 
December 20, 1948 to December 31, 1949 
A. RECEIPTS 


DS $ 7,121.01 
af a cic dc A aaa ek ae eel i oe 7,826.35 
a kt a a a a i ga ls ar ae a 156.15 
i clos heh ll a tah a al a a acl ltl ala o cal 392.50 
od. ik ose cenctcuhiaweninsiiinctsaCeeakenaees 400.00 
a als 2s ie al eons kn eee nacnich mies eka ae nledammedil 4,779.07 
i i ea ka wea eeu 3,314.41 
aS a a ala 793.50 
I a a 100.00 
Miscellaneous........ tesa hotel dha eed al nha cea PN thas tle UN asi ira Oe hd caae 169.70 

i a a li at $25 ,052.69 


* In bank deposits and government bonds. 
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B. EXPENDITURES 
Annals—Current 
Ofice of the Pditer.. ........ 0c ccs ccccscdcecss 
Waverly Press 8,777.65 


Annals—Back Numbers 
Reprinted Vol. I1 #4; IIL#4;1IV3 & #4; V#1; VI#1, 2,3 &4; 
XIII #1,2, &4.. 
Mathematical Reviews and Inter-Society Committee.......................... 
Office of the Secretary-Treasurer 
Printing, memoranda, etc. (Including some stamped envelopes).... $1,156.61 
Postage, supplies, express, telephone calls 275.00 
Clerical help 2,208.40 
223,61 


Miscellaneous. . . 
Biometrika.... A 
Balance on Hand, *December 31, 1949 


C. SUMMARY OF RECEIPTS AND EXPENDITURES 
Balance on Hand, *December 20, 1948 
Receipts during 1949 
Expenditures during 1949 
Balance on Hand, *December 31, 1949 
D. LIFE MEMBERSHIP FUNDS 


$ 9,052.65 


$ 2,910.55 
206.92 


$ 3,863.62 


$ 379.57 
$ 657.30 
$ 7,982.08 


$25 , 052.69 


$ 7,121.01 
17,931.68 
17,070.61 

$ 7,982.08 


It has been the practice to set up an amount equal to all life membership payments as a 
liability and to hold all these funds in reserve until the death of the member—after which 
his payment is released to the general fund. There were three new life membership payments 


in 1949. 
December 20, 
1948 
Number of Life Members... Reed tae RH 29 
Total Reserve Held iis ate haere: ME pO 


E. BACK ISSUES FUND 


December 31, 
1949 


32 
$2,672.50 


It has been our policy, since January 1, 1948, to use income from the sale of back issues to 


finance the additional reprinting of back issues. 
Previous balance in back issues fund 


Income from the sale of back issues during 1949...............0...60 000. cece eee ee 


Expense for reprinting back issues in 1949 
GURERTROE TC CRRIOT BE, BO oso. c. 5 ois nosei0 is eiareiss aie wise prsleelbrs.s asew er 


F. BALANCE SHEET, DECEMBER 31, 1949 
ASSETS 


December 31, 1949 
$ 3,094.08 
3,000.00 
1,888.00 
545.78 
16 , 459.22 


$24,987.08 


* In bank deposits and government bonds 
** Cost of Annals calculated at 67 cents per copy 


749.77 
3,314.41 
2,910.55 

$1, 153.63 


Increase since 
December 20, 1948 


$ 861.07 


254.56 
3,673.61 


$4,789.24 
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LIABILITIES 
Reserve for Life Memberships 
Reserve for Reprinting Back Issues 


,672.50 $ 392.50 
153.63 403.86 


2 
1, 
Gat... cee ne scenes efi tel 21,160.95 3,992.88 


$24 , 987.08 $4,789.24 


G. SUMMARY 


The surplus of the Institute has increased during the year of 1949 by $3,992.88. While this 
indicates a favorable condition, it should be noted that roughly 92% of this gain is repre- 
sented by an increase in the inventory of back issues of the Annals. This asset is definitely 
of the non-liquid sort and thus the major portion of our gain is of little assistance in meet- 
ing our current need for more publication space in the Annals. 

It should be noted that the year-end statements have always included a substantial 
amount in prepaid dues and subscriptions on the asset side without a corresponding lia- 
bility. The figure for December 20, 1948 is $4,060.50 and for December 31, 1949 is $4,682.37. 
Thus it will be seen that we are virtually running on a hand-to-mouth basis. It is hoped that 
an increase in the number of individual and institutional memberships during 1950 will 
bring us into a more favorable situation. 

Beginning with January 1, 1950 we plan to revise the bookkeeping system which is no 
longer adequate for an organization of our present size. In the future, these reports will be 
made on an accural basis rather than a cash basis and thus will present the data pertaining 
to each year on a more realistic basis. 

We are now in a position to supply all issues beginning with Volume 1. Five or six of the 
back issues are in short supply, but we expect to be able to reprint these when our supplies 
become exhausted, using receipts from the sale of back issues to pay for the reprinting. 


Car. H. FIscHER 
December 31, 1949 Secretary-Treasurer 


Cn Re ri 


REPORT OF THE EDITOR OF THE ANNALS FOR 1949 


The 1949 volume of the Annals exceeded, by a few pages, the 600 pages bud- 
geted for it at the beginning of the year. A total of 65 papers were published, as 
well as the usual reports, abstracts, and items of news and notices. The 1949 
volume was Volume 20 of the Annals, and it seemed fitting to publish a cumula- 
tive index of papers for the first twenty volumes of the Annals. Such an index, 
containing both author and subject indexes, has been published as a separate 
3l-page pamphlet and is being distributed with the December 1949 issue of 
the Annals. 

The rate of submission of manuscripts continues to increase. By the end of 
1949 enough manuscripts to fill two issues of the Annals had been accepted for 
publication. At the same time approximately forty manuscripts were at various 
stages of refereeing and revision. This means that authors submitting manu- 
scripts at the beginning of 1950 can hardly expect to see their papers in print in 
less than a year. The rate at which the average gap between submission of manu- 
scripts and their appearance in print has, for the last two years, increased about 
two issues (six months) per year. There is no reason to predict that this rate will 
change for at least another year or two. Thus, it is highly desirable that every 
effort be made to expand the publication program of the Institute during 1950. 
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The most immediate possibility would be to expand the Annals by at least 109 
pages if the budget will permit. In the meantime, it is hoped that the Institute 
committee to study the feasibility of reviving the Statistical Research Memoirs 
will be able to work out a practical plan for further increasing the publication 
facilities of the Institute. 

The manuscripts being submitted continue to cover a wide range of topics jn 
probability and statistics. There is still a scarcity of good review and expository 
articles being submitted, but with the institution of special invited addresses go 
widely discussed at the Cleveland meeting of the Institute in December, 1948, 
we can expect to receive more review and expository articles in the future. 

The Editor takes this opportunity to acknowledge, on behalf of the Editorial 
Committee, the refereeing assistance which has been generously given during the 
year by the following persons: A. C. Aitken, E. W. Barankin, Z. W. Birnbaum, 
R. C. Bose, A. H. Bowker, G. W. Brown, K. L. Chung, W. J. Dixon, A, 
Dvoretzsky, Hilda Geiringer, L. A. Goodman. T. N. E. Greville, F. E. Grubbs, 
John Gurland, M. H. Hansen, T. E. Harris, H. O. Hartley, E. L. Kaplan, B. F, 
Kimball, T. Koopmans, Julius Lieblein, H. Levene, M. 8. MacPhail, P. J, 
McCarthy, R. B. Murphy, G. E. Noether, E. G. Olds, P. S. Olmstead, Richard 
Otter, E. Paulson, M. P. Peisakoff, E. J. G. Pitman, Milton Sobel, D. F. Votaw, 
Max Woodbury, and J. L. Walsh. 

Thanks are due to Mr. M. E. Freeman, Mr. L. A. Goodman and Mr. E. F, 
Whittlesey for preparation of manuscripts and to Mrs. Lily D. Smith for other 
editorial and office assistance in connection with the Annals. 


Finally, on behalf of the Editorial Board, which has had the responsibility for 
editing the Annals since 1938, the Editor extends every good wish to the new 
Editor, T. W. Anderson, and the new Editorial Board, who will inherit nearly 
a full year of accepted manuscripts but will otherwise assume editorial responsi- 
bility for the Annals beginning with the 1950 volume. 


S.S. Wixs 
December 21, 1949 Editor, 








